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PERIOlKHiKAM ANAtA'.St.S AXI) CONTINnOUS SPECTRA 

By M. H. BARTLK'IT, Vnivcraity of Manchester 

I. iNTiioin'CTKm 

It haa 1)««n mUizini fur w>mi‘ tinw that the flaasiml methwl ofsearchine fo • • 

time series, tho »o mlliHl |H*ri,Kl.,grani analysis of the soriea, ia uselms b “ 

alternative apimau'h hy way of the aufon-gn-aaiv.! or autocorrelative strnctur^f 

was oonsid«wi in a iiioiiwrijig paia-r hy Yule {1027), and more recentlv 

(see espociaiiy M. Cl. Keiuiall {1 !)4f))). ^ ^ters 

A fuller underMtanding of t he scoja* ati.i ndation of these methods is obtainahl 
mathematical thw,ry of atetionary ran.i»,m or «t<Kdia«fcio processes develo-nsri +^1 ! 
twenty years hy Wi(‘ner {UWn), Khinfi-him* (1034) and others (for an account of tK’ o 
seelAvy (IB4H). t*|K^eially eimpter iv; for further nwiews of the general 
procosBOS also f 'ram,V (1{)47), Moyal (1040)). By ataUmarif is meant, rouThly 
that the aeries ia tweillating or IhirtuiitH.g ala.ut a constant mean; more precisely th t f 
distributhjiud properthyi in the atocliastic maim do not depend on the absolute’val f 
the time {m.to that a aiinplo hanmuiic wnw i« not atatioimry in this sense unless its inLal 
phaae is random). For many puri«w« ut the correlation and harmonic theory of these 
processes it is auftlcirmt to awume statjonarity ' to the »c‘cond order*, that is in addition to 
the mathematical exiKwUtion m nUmhmihi average A'{X{1)} » constant* 0 say for the 
value of the soriM X at tirno t, the aMt<M^»variano 0 function 


« !r{T), 

does not dei^nd on t and is a function only of the inten-al r. (X*(t) denotes in general the 
complex conjugate q(X (t), though m t he later application here of the theory it wiU be assumed 
that the series is real.) If X ia Ktandardiz«l )jy dividing by its constant standard deviation a, 
assumed finite, equation (1) givw the ttuUmirndation function p{()aic(r)/(r*. 

If it is further a«mmed that JCtt) is wmtinuous in mean square, that is, 

Lt A||X{l 4 A) -A'Ct)!*} «. 0, 

k-*4 

a condition easily seen to l>e equivalent f*i /dl) Iwing continuous at t » 0, then it is known 
(of. Khintolune, 1034) that the nw-eesary and nuffieient iHjndition for p(t) to be a valid auto¬ 
correlation function is that it i» pspttsssuhle in the form 


Pin - f (2) 

J m 

where X(co) has the form of a cumtdativo distnbnlion function, and is the Integrated speeimm 
of the procMs. The oorreaponding thi4t,rem for pn:K»«»Mi defined only at disesrete integral 
values of time is (Wold. 1 938) 

p, « J* e.*^dF(ca). (3) 

CorreBpondmg to (2), there is an equivalent relation for X(t) itself, sOTociated with its 
armonio analysis (first <^tabUalied in full generality by Cramdr (1842; cl Slutsky, 1938; 
see also Uvy, 1948. § 27, oh. iv), namely, 

f m _ 

(4) 
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2 Periodogram analysis and cayitinumu^ spectra 

where the orthogonal stochastic process Z(w) has the property 

LI{w) = + Ao)) ^Z[o>)} = E{^Z*{(,i) A2:{«)}, (6) 

where A denotes as usual a first difference, and the akxihaslio .Stieltjes integral in (4) is defined 
as the limit in mean stjuare of appropriate stochastic sums. 

Similarly, corresponding to (3), the relation is 

X, = r e«“d;Z(w). (6) 


2. The spectra or mneab processes 

The relevance of the above results becomes clear w'hen it is remembered that the general 
distribution function in (3) may consist of a discrete or continuous distribution, or of both. 
Only in the first case of a discrete distribution, apart perhaps from an atlditional purely 
random error or ‘noise’ leading to a uniform continuous distributional component, is the 
conception of a classical harmonic series valid. In general the possibility of any kind of 
continnous component to the spectrum must be allowed for. 

The very generality of these results becomes embarrassing when it comes to the analysis 
of actual series, and further assumptions about the character of the series are usually neoee- 
sary in practice before much progress can be made—hence the importance r)f one general 
type of series distinct from the classical harmonic aeries and having a continuous spoctnim. 
This was studied in a special case by Yule, but a much more general form, for which the term 
linear process has been used (Bartlett, 1946), is 

-3:(<)=£j7(<-«)dr(R), (7) 

t 

or for discrete time gi-vWu, (S) 

— CO 

where the randpm ‘ disturbances ’ Ti(j or dT{«) are independent and stationary. It may readily 
be shown that when the coefficients or g{t-v) are such that or X{i) is well defined, 
then the series is stationary with autocorrelation function 






or 


P(t) = o-g f g*{u) g{u + t) clu/cr*, 
J —to 


(9) 


( 10 ) 


where for convenience in these formulae « runs to - oo with or g{u) mQhxu^O, and whore 
erg IS the variance of BJ, or, in the continuous time case, the variance of the integrated dis¬ 
turbance over unit time, j dY{u). Hence if 

h{u)) = 


S e 
00 






u: 


i«4> 


g(u) du, 


autocorrelation function by ‘inverting’ the relation 
(3) or (4), IS found to he continuous with probability density 

f{oi) = o-g;i(w)A*(w)/(27ro-*). 


( 11 ) 
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It should be noted that any stationary process with continuous spectrum can mathe¬ 
matically be expressed in the linear form 

= f 9 {t-u)dY{u), (12) 

J —oa 

but, in contrast with (7), g{u) does not necessarily vanish for « < 0 (and similarly for formula 
(8) in the ease of discrete time), and further the dYiu) are uncorrelated (orthogonal) but not 
necessarily independent increments (see Karhunen, 1947). 

As an example, consider the simple autoregressive scheme 

-1- bXf — (a > 0), (13) 


for which, from the solution of this difference equation for X,, 


!7,.= 


Xn+l 

X—fi 


(14) 


where A and/f are the roots (assumed complex) oix^-}-ax + h = O. The ratio crg/o-^ is given 
from (10) or (11) when r = 0, and it will be found that (of. Bartlett, 1948) 

^/(^) (i + 6){H-a®-|-6^—26-(-2»(l-t-6)cosw-|-46cos®Gj} TT-^a^Tj, 
or if, as is more usual for real series, /{<>))+f{ — (o) - 2f{oj) is denoted by f+((o) defined for 
0, the expression in (16) is 7r/+(w). 

If it is known that a series is, say, of the simple type (13), its autoregressive constants 
a and b can be estimated, and hence the spectrum calculated from formulae such as (16). 
However, while it is possible to test approximately the goodness of fit of the corresponding 
calculated autocorrelation function or ‘correlogram’ when compared with the observed 
oorrelogram (Quenouille, 1947), it may be required to make a direct empirical study of the 
spectrum without any intermediate assumptions about its particular autoregressive struc¬ 
ture. 


3. Stoohastio propebtibs op the periodogram 


The classical analysis of a (discrete) series of n observations consists of computing the 
Quantity /o ^ 

(16) 

(by computing Ap and Bp), and hence the intensity/I), = HpH^. The factor \j{2ln) has been 
inserted to make the mean value of Ip equal to 2(r“ for a completely random series. 


It is easily seen that 
where <u = ^npjn, or if 0/ = 


2 n A 

= - S 'ZKfXpOos<j){r-u), 

^ (s>0,0_, = 0.), 


then 


n~l 

4=2 S 

—tt + l 




Cg cos (03. 


(17) 


(18) 


For convenience it is still assumed that B{X} = 0, but since formula (16) may be used when 
B{X} + 0, the effect of this.will be noted later. When B{X} = 0, the average of equation (18) 

B{Ip} = 2(r^ "S fl-L^)p,ooaa)5. (19) 

As n increases, this tends for most values of (O to 27r«r®/+(w), where /+(w) is the (continuous) 
spectrum of X^. 



4 Periodogram analym and cmtinuom 

rr^ 1 argument consider what liauFttB when X, nmlmm* a larmojtfft 

The usual penodogi g comiwnent Aetwiit. timm^ in fh» % 

component = O, it is evident that #;| 4 I m.ift.i.d 

spectrum oontams a jjnown, butisnoted here for mfemiu'**. Th^‘ w.wi ril,ut,ciB»fty 

at, j ^ ^0 but 0 (n) »t w - O. anti the *«ai> r«i w*A« 

is now apparent; itintrod»«a a sporioua eoinponent of llirn lyi* »< 'li- >.™m ... - 0.) 

It has also been recognized that a. the intensity /, f|U«t«ato« nf.urt 
Ell) == 2a^ for a completely random series, it is advisable when tin* mmmr».um rf tb 
periodogram peaks are considered to allow for such Buctnatiorm, wh.rh *ro kro.wn to Mlm 

the probability law P{4>z} == oxp{- 2 /£?{ 4 )}, f«| 

when X. is normal (see, for example, Fisher, 1929). 

Once the possibility of continuous spectra, Iwyond the uniform 'now^ of lb 

completely random process, is admitted, the situation is mmpfotoly rb»nji«l, X«t orfy 
may a non-tmiform continuous spectrum have Faks which may lx* ix,rn|Wirabfo f**f * finite 
n with the value of ^{Ip} even at the frequency fi of a diacreto harmonic . bttitls 

fiuotuations in 4 possess the remarkable proFrty, exhiin'ted in ( 2 f>) jn the mm 

of the uniform spectrum, of being of the same order as the mean valuer 4 I irtwsjwgtftiite 

of the length of series available for analysis. This has been notwl by Miit«»ky f 1 fh17| Mid by 
P. J. Daniell (see the discussion to the paper by Bartlett, 194ft). the mHxmd wntor giving m 
explicit derivation which includes the property (also not^xl by Hhifoky) that !h«^ «wwiimtJ( 5 i 6 
or correlation of 4 and Ij, for p + g is in general of 0(l/n.*). To drmnnatra!*' fitrthw tk 
approximate^ validity of ( 20 ) for normal Z, (or more generally for appitiximat^-ly normal 
Aj, and Bp), it remains to show' that the two eomponenta have otpial vanajm^ «id *em 
correlation, at least as n->Qo. To do this, consider S{Iip), Thk’ i» 


f 2 ’I IV 

lnr=l n=l 


)U ~ S £ c«^ 

2o- 2 «-i efl*'+*><"(l —«*"“*'••>**') 

n .-?n+i^* T~e» 


»tUi 


20-a n-i 
]u 


n 


.P> 




«~-n+l 

tt-1 

M S 




(for p 


_^ e***ain|s[fti 


Binw 


(11) 


This is exactly zero for p, = 0 (s + 0); but it is also 0( Ijn) otherwis®, p«wld«l th»t. t-be «u» 
Sp,sin I a 1 w converges as n->oo. Since 

the required results are thus established simultaneously. 


4, SmOOTHIKO THU PXBIOD OGHAM 

These results stress the fotiHty of appraising the significance of peaks in 4 « p variw by the 
epical method when the spectrum is continuous, but they do not indicate haw the lslt« 
to be estimated. In such a case the standard Friodogram will exhibit a wildly 

oleLS P- (*0) but « b 
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appearance, a phenomenon which has often been observed in practice. Averaging over 
neighbouring values of or w was suggested by P. J. Daniell, a device which might be 
especially useful in automatic electrical or optical analysis of a continuous record (for 
simplicity the theoretical fluctuation formulae have beep discussed for a discrete series of 
n observations, but similar formulae apply to the continuous time case). Por arithmetical 
analysis the following alternative procedure has been suggested (Bartlett, 1948). 

An average taken from m independent aeries ‘lengths’, if available, would possess the 
usual sampling property of its fluctuation being proportional to If the lengths were 

taken consecutively as contiguous portions of one length of series, the correlation between 
quantities like Hj, derived from different portions will be neghgible as the length n of each 
portion inoreaaes, provided pg decreases fast enough as s mcreases. Por example, even between 
adjacent portions, . 

S 1-i^ 

«=-n+l \ Ui / 

where B. and B.' are obtained from the two portions, and this expression tends to zero as 

n increases provided pg contains an exponential damping factor. Now averaging 4 

m subseiies gives the formula 

° - ’‘-i / A \ - 

4 = 2 S (l-‘—IjCgCosccs, 

a^—n+lX ^ / 

_ 1 m-ln~a 

■W’liei’e Cg = ^r+nu^r+s+n^ {^>0). 

This formula ignores, however, the information available in the interval s at the end of each 
subseries; if this is replaced by use of the covariance estimate from the whole data, the 
amended formula is n-i / l i\ 

4(smoothed) = 2 S j 1 — ) C^oosws, (22) 

s=-»+i\ w / 

where Og is obtained from the entire series. The choice of« in this formulae (for given nm) is 
a compromise between reducing the fluctuations by the approximate factor not 

reducing too much the resolving power, which depends on the value of n. Formula (22) is 
related to the harmonic analysis of the correlogram (cf. D. G. Kendall, 1948), which would 
often have been calculated already, and it is sometimes convenient to use the sample auto¬ 
correlation Rg in place of Gg. In either case it is usually advisable to eliminate the spurious 
oomponent at w *= 0 by measuring X from the series mean. 


6. BmpIRIOAL VBBnrOATION 

Empirical verification of the validity of the suggested procedure was carried out on 
M. G. Kendall’s artificial series (loc. oit.), for which the theoretical spectra can he calculated 
by means of formula (15). Some preliminary calculations reported earlier (Bartlett, 1948) 
also tested a cruder form of formula (22) in which the factor 1 —) 5 j/m was dropped. This was 
found, however, to lead to relativelysmall but systematic oscillations which are best avoided. 
It was also found that the differences between working with correlations and covariances 
appeared negligible, and it was preferred to work with the covariances (using for this purpose 
sums of squares and products kindly supplied by M. G. Kendall). Since the artificial series 
were already measured from the mean, no correction for the mean was necessary. 



6 Pzriodogram amlysis and continuous spectra 

Series I and III we selected as representative cases, and after toting out f(.rmuljM22) 
on the whole series further oalonkrions on subseties were made to check tim t.rder of both 
systematic and random fluctuations of the smoothed periodogram from the true siH‘drn,n. 
For reference the values of a and h for the two series are; 


Series I (total length 480 terms): a = - 1 • 1, b »-5. 

Series III (total length 240 terms); a = - 1 • 1, b ^ Q'H. 


The distribution of the random disturbance W for these series was rectangular, not normal, 
but this does not affect the asymptotic distributional theory oi Up &Bii incrcasea. 



Pig. 1. Periodogram analysis of Series I —smoothed periodograma (n =; 15 and 30) 
and unsmoothed (M. G. Kendall), compared with true spectrum. 


In formula (22) the choice of » = 15,30 and 46 for Series I gave m » 32,10 and 12| w»po0“ 
tively when the total length was used; and n « 15 and 30 for Series III gave m - 10 and 8. 
Similar oalculatioua on subseries lengths of 60 terms for n = 16 and 30 oom«iK)ndwi of 
course to smaller m and hence larger fluctuations —m = 4 and 2 respectively for both series 
(these subseries calculations were confined to the more interesting half of the froqueney 
range containing the peak of the spectrum). 

The results of these computations are given in Appendix A (Tables 6-10). The intensity 
X was suitably standardized in the case of the covariance calculations by division by the value 
of the variance <r% and hence was comparable to 2nf^{{o), also shown in Tables 6 and 6. The 
values were calculated for gsSOci/jr running from 1 to 30 (the corresponding values of p 
are - ug/60). The results for the total series are also iUustrated in Figs. 1 and 2, wJiioh 
show the smoothed periodograms for Series I and III respectively (n » 16 and 30) together 
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with the true spectrum. In the case of Series I some values of the unsmoothed periodogram 
(suitably adapted from T able 4‘1, M. G. Kendall (1946)) are also plotted for comparison, 

In order to examine the extent of validity of formula (20) and the smoothing properties 
of (22), it is first noted from (20) that 4/jS(7^) is approximately a with 2 n.i'. and fluctua¬ 
tions in any smoothed periodogram would consequently be expected to be roughly equivalent 
to distributions with 4, 8, etc., degrees of freedom according to the smoothing adopted. 
This could be tested by means of an appropriate adaptation of the homogeneity of variances 
test (Bartlett, 1 (j;i7). To cover deviations in both 1^ and E(I^) the values of s 4/[27ro-2/+(<u)] 
were evaluated over the range for which the smoothed periodograms for the subseries had 
been computed. Since the suhseries lengths were all 60, the case % = 30 should correspond 
to with 4i).i?,, w = 16 to 8d,I!\ 



Pig. 2, Smoothed poriodograraa (?t = 16 and 30) f</r Series III, compared with true speotrum. 

In the ease of Series I, this was almost completely verified. The over-all fluctuations were 
split up into fluctuations at any frequency o) and systematic deviations of the average at any 
frequency, i.e. + 

The values of 4 oould further be compared with the average over p, Jp, say, the average 4 
being tested separately. The analyses given in Tables 1 and 2 were obtained. 

It will be seen that the only significant (P = 0-06) departure from the asymptotic dis¬ 
tribution was iu the systematio deviations••4 for 71 = 16. This may be due to a real bias 
(of. the results below for Series III), but might also he partly due to the periodogram being 
evaluated for integral q, which for ■» = 16 corresponds to quarter-integers for p; this would 
imply considerable coixelation between neighbouring points even for a completely random 
series, whereas the above test assumes independence. 

In the case of Series III it will be noticed that the amplitude of the peak of the smoothed 
periodogram fails to reach the 'true value’, especially for n = 16. That this is a real 
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Periodogram analysis and continuous spectra 

Tables 1 and 2. Analysis of Jluduations by approximate 

Series I. n=30, 



-1 

D.IT^ 

Crude ^1* 

CtirroeU-d x* 

JJJ p 

106 

128-38 

- 


14 

17-84 

1 


1 

0-10 

i 

1 

Total 

120 

146-38 

136-12 

Series I. «■= 16. 


D.V. 

Crude 

CorriKjttxl X* 

JJJ V 

106 

96-62 


3JJ, 

14 

26-91 

24-81t 

dp 

1 

1-21 

— 

Total 

. 

120 

122-74 

1 


t Signifloant at P=0'06 level. 

Note.. For a teat of the umonditioncU likelihood fvmotioii is required, the comHtTwruhnM mule 
‘for an average of 8 x 16 = 120 items being 

- 240m log J,+240m(Ja- !)• 

Similarly, the oorreoting factor for the total ia 1+^ =■— for n = 30, mK2, 


Tables 3 and 4 
'Series in. n=:30. 



P.F* 

Crude x* 

Jp/Jp 

46 

27-71 

^fljv 

14 

178-08t 

1 

6-Olt 

Total 

60 

211-80t 


Series in. «= 16. 



DJ. 

Crude x* 

Jp/dp 

46 

27-78 

Jp/d p 

14 

319-83t 

dp 

1 

31-68t 

Total 

80 

879‘10t 


t Significant at PssO-Ol level. 
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systeitiatic error due to the short length of the equivalent length of series may be cheeked 
from tlie corresponding analysis of the fluotuations for the subseries (Tables 3 and 4). 

riiis damping of the peak must, however, be expected for comparatively small n in the 
case of series with little-damped oscillations. It will be remembered that in the case of 
classical harmonic analysis with a discrete spectrum the true amplitude (with this standardi¬ 
zation) would be infinite, whereas that of the periodogram would still be fltnite, and the 
smaller and less well resolved the fewer the observations. 



Fig. 3, Correlogram of Wolfex’s sunspot numbers (Yule’s graduated series, 1749-1924). 

It may be concluded that with the present method of estimating a continuous spectrum 
by smoothing the periodogram excessive curtailing of the correlogram is inadvisable if the 
amplitude of the peak is to be estimated as well as its location. The estimated spectrum is in 
general a consistent rather than a strictly unbiased estimate, approaching the true spectrum 
if the series is large enough for adequate smoothing and yet n is also large enough. The 
value of n to take may (of. Bartlett, 1948) be judged from the amount of damping in the 
correlogram. 

Among subsidiary effects in the above analysis for Series III will be noted (i) a tendency 
for fluotuations about to be less than expected on the asymptotic theory, and (ii) a mean 
bias Jpt espeoiaUy forn =» 16. 

6. Smoothed pebiodogram eob Wolebe’s shitspot httmbbbs 

This method of smoothing the periodogram was also tried out on Wolfer’s sunspot numbers 
as an example of an actual series, in contrast with the artificial series discussed above. This 
series was the first to be analysed by the autoregressive method (Yule, 1927), and for com¬ 
parative purposes the present analysis uses the same (graduated) series studied by Yule, 
i.e. j&rom 1749 to 1924. The observed values of for « = 1... 23, are givenf in Appendix B 

t There are some trivial differenoes between these values and those given by Yule for « = 1... 6, 
possibly due to the formulae or method of computation used. 



IQ Periodogram analysis and continuoU’S spectra 

(Table 11) and in Fig. 3. Ynle’s graduated values were used because previous aunlyKiH by 
Yule and by the author (Bartlett, 1046) respectively suggested that these ■values might 
correspond to an autoregressive model of type (13), or to the corresponding analogue dehned 
for continuous time, Ho'wover, the calculation of the more complete corrclograin established 
the untenability of either assumption, at least in this simple form (e,g. hy Qiienouille k 
test in the case of the discrete time model, and, in the case ot continuous time, by an adapta¬ 
tion of it to be reported elsewhere in collaboration with P. H. Diananda). 

But in spite of the absence of any simple adequate autoregressive model, the m^ries is one,, 
as Yule pointed out, for which classical harmonic analysis is of doubtful valui', although 
periodogram analysis of the aeries has from time to tune been made (Schuster, 11106; I^arnuir 
So Yamaga, 1917). In order to investigate its spectrum without a knowledge of the under¬ 
lying mechanism, the smoothed periodogram (with n = 24) was calculatcfl for q HBw/tt 



from 1 to 30 and is given in Appendix B (Table 12) and Fig. 4. There is ft rise towftrdft w - 0; 
m spite of possible small contributions due to the incomplete elimination of the mean or to 
the effect of the graduation this suggests a real component of non-oaoillatory or 'Markoff 
type, and indicates how a somewhat better fit might be obtained for the oorrelogram by 
addition of such a component to any theoretical model for the process. As such an empirical 
extension of the autoregressive model does not greatly contribute to the interpretation of 
^e observed data it is not pursued in any detail, but it may be of interest to note Sir Gilbert 

^ 

ofSk interesting range consiats 
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7. Conclusions 

'fiio (iiHtiuHHicin ill iliis paper has emiihasized fcliat the more comprehensive theory of periodi¬ 
city in time series now availaiilo throws up problems in sampling theory of considerable 
complexity and, up to recently, largely ignored. While other branches of mathematical 
BtatiKtics have developed an extensive distributional theory of sampling variability, in 
contrast with the earlier ‘large-sample’ theory, the sampling\theory of time series is on the 
whole still in the more primitive ‘large-sample’ state. The estimation and assessment of 
accuracy of autoregressive constants and the goodness of fit test of the correlogram fall into 
this category. 



It haa been iminted out that some method of smoothing the periodogram of 
oontimioua spectrum is essential, as the classical method gives no convergence oatesoxv 
spectrum. While the method reoomraonded above also falls into the derived' 

and no preoia© testa of the sigtiificanoe or aoouracy of any observed peaks ave ^ 

the value of the method would appear to have boon established by the above 
short series the amount of smoothing possible will not be sufficient^ shows 

sampling fluotuations from one ‘sample’ to another, as is illustrated in greatly 

two oontraated curves for subseriea (i) and (ii) (Series I), of total lengt > however 

in their evidence for ‘periodicity*. The order of magnitude of the ^ 

known, ranging from the asymptotic formula (20) in the case of the unsmoo , . 

to the 1/^ reduction factor when smoothing is adopted. The aPowsarough 

resolution for different frequencies is also known, both depending onn. iw 

assessment of aignifioonoe of variation in amplitude to be made, an won 

at least have prevented the many doubtful claims of multiple peno s ° 

literature (for example, by Brownlee (1917) in the case of the periodicity o m 
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Summary 

The problem of investigating periodicity in time scries is considered in tlte liglit of theoKdica 
developments in the harmonic analysis of stationary stochastic processcfl, it is for st’ries is itl 
continuous spectra that classical periodogram analysis is often useless and misirading, 

A proposed method of smoothing the periodogram, making use of the eorrelngraju. i) 
tested arithmetically on two of M. G. Kendall’s artificial sorios, and a statistical analysis nuuif 
of the fluctuations in the smoothed periodograms. The method is also tesU'd tin Wtjlfer'f 
sunspot numbers. These empirical tests supplement a theoretical discussion t»f the asyinpttd it 
properties of the method. 


I am indebted to Mass R. M. Dyson for most of the computational work involved in thif 
investigation. 

APPENDIX A 

Smoothed periodograms for M. 0. Kendall’s artificial Series I and III (stamlardiml to nf^ [m] 
and tabulated for integral values ofq = 30«/7r) 


Table 6 

Scries I. Total soriee. 


<!) 

From correlations 

n=:45 

n = 30 

ko 

11 

1 

3-208 

2-936 

2-913 

2 

3-082 

3-247 

3-083 

3 

3-809 

3-606 

3-068 

4 

2-821 

2-899 

2-821 

6 

2-293 

2-297 

2-693 

6 

2-359 

2-474 

2-486 

7 

3-028 

2-786 

2-366 

8 

2-408 

2-368 

2-046 

g 

1-198 

1-261 

1-647 

10 

0-763 

0-889 

1-092 

11 

0-930 

0-847 

0-879 

12 

0-630 

0-686 

0-684 

13 

0-478 

0-488 

0-667 

14 

0-344 

0-348 

0-411 

16 

0-180 

0-216 

0-289 

16 

0-183 

0-196 

0-226 

17 

0-164 

0-168 

0-199 

18 

0-099 

0-123 

0-176 

19 

0-140 

0-136 

0-217 

20 

0-139 

0-143 

0-163 


0-109 

0-122 

0-147 

22 

0-114 

Q-111 

0-130 

23 

0-066 ' 

0-081 

0-108 

24 

0-066 

0-067 

0-093 

26 

0-069 

0-066 ' 

0-089 

26 

0-062 

0-062 

0-086 

27 

0-066 

0-068 

0-079 

28 

0-049 


0-076 

29 

0-066 

0-067 

0-077 

SO 

0-048 

0-068 

0-077 


From covariances 

i 




i True 



. 

vaUiea 

n=46 

n=30 f 

n=16 


8-192 

2-038 

2-916 

2-219 

2-994 

3-264 

3-0H9 

2-3«tl 

3-884 

3-617 

3-066 

2-060 

2-893 

2-906 

2-827 

3-030 

2-204 

2-294 

2-604 

3-396 

2-331 

2-477 

2-489 

3-493 

3-136 

2-792 

2-370 

3-091 

2-890 

2-371 

2-046 

2-363 

1-168 

1-247 

1-499 

1-041 

0-811 

0-887 

r-09l 

1-118 

1-006 

0-848 

0-822 

0-773 

0-648 

0-687 

0-084 

0-649 

0-482 

0-486 

0-660 

0-403 

0-436 

0-343 

0-408 

o-ao6 

0-180 

0-216 

0-288 

0-237 

0-087 

0-109 

0-227 

0-190 

0-198 

0-169 

0-199 

0-166 

0-179 

0-123 

0-177 

0-130 

0-066 

0-136 

0-100 

0-1 n 

0-088 

0-143 


O-O90 

0-203 

0-121 

0-140 

0-086 

0-124 

0-111 

0-129 

0-070 

-0-035 

0-080 

0-107 

0-009 

0-097 

0-070 

0-092 

0-064 

0-142 

0-063 

0-086 

0-069 

-0-018 

0-068 

0-081 

0-060 

-0-008 

0-064 

0-070 

O-OM 

0-142 

0-067 

0-074 

0-063 

0-066 

0-066 

0-076 

0-052 

-0-061 

0-068 

0-077 

0*051 
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Series III. Total series. 



n=] 


True values 



Table 7 

Series 1. n=30. 


Subseriee of 00 terms 













































mm 


wuKfj 


umiMm 


(ii) 

(hi) 

0-699 

2-784 

0-996 

2-637 

1-088 

2-169 

1-166 

1-646 

1-829 

1-614 

3-078 

1-768 

4-061 

1-878 

3-913 

1-604 

2-797 

0-874 

1-824 

0-470 

1-066 

0-431 

0-969 

0-608 

0-817 

0-478 

0-461 

0-366 

0-169 

0-296 


(v) 

(vi) 

(vii) 

1-978 

2-731 

6-483 

2-623 

3-189 

6-836 

2-624 

3-248 

6-008 

2-249 

2-666 

4-427 

1-999 

2-003 

2-985 

2-228 

3-267 

2-346 

2-640 

3-487 

1-074 

2-320 

3-038 

1-319 

1-664 

2-060 

0-662 

0-822 

1-199 

0-476 

0-672 

0-834 

0-676 

0-668 

0-782 

0-762 

0-666 

0-698 

0-673 

0-460 

0-490 

0-460 

0-236 

0-289 

0-400 


4 

2-016 

‘4 

3-080 

6 

3-065 

0 

2-827 

3 ‘ 

2-.704 

3 

2-480 

« 

2-370 

6 

2-04S 

.5 

1-409 


1-Ofll 


Table 9 

Senes in. n=30. 


Subseriea of 60 terms 


(iii) 

(iv) 

0-318 

0-740 

0-416 

0-169 

0-890 

0-436 

0-772 

0-036 

1-482 

1-400 

2-396 

0-830 

7-830 

6-368 

8-274 

7-413 

4-763 

3-640 

6-008 

3-212 

2-939 

3-676 

0-919 

1-416 

0-649 

1-329 

0-393 

0-268 

0-320 

0-211 


Average 
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Table 10 
Series III. n= 16. 


16 


? 



1 

2 

3 

4 
fi 
6 
1 
H 
9 

10 

11 

12 

13 

14 
16 


4 

I 

i 



Subseries of 60 terms 


Total 

series 

m 

(ii) 

(iii) 

(iv) 

Average 

O-601 

0-063 

0-466 

0-809 

0-607 

0-630 

0-834 

0-830 

0-670 

0-761 

0-771 

0-774 

1-222 

0-787 

0-776 

0-642 

0-867 

0-882 

1-649 

0-762 

1-060 

0-773 

1-033 

1-046 

1-842 

1-138 

2-044 

1-644 

1-642 

1-666 

2-227 

2-046 

3-772 

2-968 

2-764 

2-660 

2-731 

2-962 

6-618 

4-433 

3-911 

3-768 

3-120 

3-189 

6-347 

6-131 

4-449 

4-496 

3-003 

2-690 

6-893 

4-747 

4-081 

4-309 

2-604 

1-698 

4-638 

3-662 

3-101 

3-330 

1-012 

1-112 

2-968 

2-506 

2-049 

2-138 

0-822 

0-928 

1-686 

1-616 

1-263 

1-234 

0-378 

0-834 

0-877 

0-977 

0-766 

0-721 

0-239 

0-612 

0-488 

0-618 

0-464 

0-460 

0-233 

0-361 

0-366 

0-264 

0-301 

0-291 


APPENDIX B 

Table 11. Corrdogram of Wolfer's mrm^ot numbers (Yulds graduated series, 1749-1924) 


« 

R, 

B 

R. 

B 

R. 

1 

0-8408 

9 

0-3646 

17 

-0*2683 

2 

0-4716 

10 

0-6197 

18 

-0-2179 

3 

0-0470 

11 

0-6273 

19 

-0-1266 

4 

- 0-2047 

12 

0-3937 

20 

-0-0096 

5 

-0-4059 

13 

0-1791 

21 

0-1143 

6 


14 

-0-0390 

22 

0-2036 


-0-1636 

16 

-0-1947 

23 

0-2132 


0-1088 

16 

-0-2706 




Table 12. Smoothed periodogram (n « 24) of Wolfer’s sunspot numbers 
{standardized to rrf^.{<t)) and tabulated for g = ^^(ojrr) 


5 


a 


S 


1 

3*269 

11 

1-864 

21 

3-047 

2 

3-138 

12 

2-792 

22 

2-237 

3 

2-927 

13 

3-913 

23 

1-629 

4 

2-621 

14 

6-017 

24 

1-203 

6 

2-231 

16 

6-883 

26 

0-921 

6 

1-790 

16 

6-339 

26 

0-714 

7 

1-366 

17 

6-304 

27 

0-689 

8 

1-060 

18 

6-809 

28 

0-489 

9 

0-986 

19 

4-982 

29 

0-426 

10 

1-287 

20 

—- - - -I 

4-004 

_ 

30 

0-398 
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NOTES ON CONTINUOUS STOCHASTIC PHENOMENA 

By B. a. P. MORAN, Institute of Statistics, Oxford University 

The study of stochastic processes has naturally led to the consideration of stochastic pheno¬ 
mena which are distributed in space of two or more dimensions. Such investigations are, for 
instance, of practical interest in connexion with problems concerning the distribution of soil 
fertility over a field or the relations between the velocities at different points in a turbulent 
fluid. A review of such work with many references has recently been given by Ghosh (1949) 
(see also Mat6m. 1947). In the present note I consider two problems arising in the two- and 
three-dimensional cases. 

Relations between oontinttotis and disoonttnuoes bkooessbs 

Stochastic variables defined for points on a plane may be considered as defined at a discrete 
set of points (for example, at all points with integral co-ordinates) or for a continuous domain 
of points. The latter is the natural approach when considering soil fertility, but in the study 
of the efficiency of experimental designs it is more natural to consider the fertility as varying 
disoontinuously from plot to plot rather than within each plot. Tor this reason I begin by 
considering the relationship between continuous and discrete models of such phenomena. 

Pirst consider stationary stochastic processes in one dimension defined by variates x{t), 
where t is 'time’ and takes either integral or a continuous range of values. Continuous 
processes whose variate x{t) has a correlation function 

p(i!) = exp[-A|<|] (1) 

are known (Bartlett, 1947, p. 79) to exist and to have a spectral density given by 

(•ao {*a> onutBfJB 

so that Pit) = J ^ cos tddWid) = 2A J ^ • 

Prom such a continuous process, a discrete process can be derived in two ways. Pirst we 
might consider the values of x{t) only at discrete values of < (= 0, + 1,... say). Such a process 
would have the serial correlation 

= exp[-A|al] (a = 0, ±1, ...), 

and could be regarded as being generated by a simple Markoff relation of the form 

where is a stationary process which is not necessarily completely random but never¬ 
theless has all its serial correlations zero. 

In practice it is perhaps more realistic to consider discrete processes derived from con¬ 
tinuous ones in another way. Suppose we write 

f 84-l 

x{t) dt, (3) 
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where s takes values 0, +1, ... and the integral is a stochastic integral . A completely 
rigorous discussion of this definition would be neither short nor (in the present conntixif)n) 
very illuminating, and we do not enter into such considerations here, (b or a general dia- 
oussion of such questions see L6vy, 1948.) It is clear that/)(t) is continuous at t » 0 and con¬ 
sequently *(<) is ‘stochastically continuous’ (Bartlett, 1947, p. 77). To discuss tho correla¬ 
tional and spectral properties of X(5) wo may therefore argue as follows. We approximate to 

C‘+i 

Z(a)=J x{t)dt 

by a sum, and to find var X («) and cov {Z(«), Z (s -fi h)}, we bake the expectations of the sums 
and proceed to the limit. In this way we find 

var Z(5) = E{X{s)Y = da f ^ dt exp [ - A ] a - b 1 ] 

Jo Jo 

Similarly, for 1 

E{X{s}X(s-k)} = E{X(3)X{s + k)}^ f^daf d6oxp[-A| fc + 6-aj] 

Jo Jo 

«le-Afc(eA_i)(i_e-^). 


Thus Pj, (k > 1), the serial correlation of Z(s) and Z(s -f k), is given by 

e-Ai (gA _ ^ _ g-AJ 

P, = P-u - •—e-A) - ° ^ 


(4) 


Then as A-> 0, 1 and as A-^co, p^->0 as we expect. Now, using tho fact that 

sinh A = 1(6^ - c~^) > A for A > 0, 

it can be easily shown that 

(e-A -1) (1 - e-^) > 2(A - I -t 6-''), 
and therefore Z > I. 

On the other hand, it is easily verified algebraically that pi A e-^ < 1, Formula (4) is not 

the sort of correlation function which would be obtained for a iwooess wlxioh is tho solution 

of a simple stochastic difference equation of Markoff type because A > 1, but we may oon- 

struct a simple mechanism which would generate a process having tho above eorrelationat 

properties. Write r = e~^. Then the serial correlation generating function of the proooaa 

-^(«) is « «, 00 

SpfcZ* = l+A'tr’‘z'‘ + A^r’‘z'’<’ 

-00 

. , , Arz , Arz~^ 

1 — 

== l + y^-2Ara + (A -l) rz -P (A -1) rz-i 
(T^(l-rz-i) 

_ (a+/gz) ja + fiz-^) 

~(l-rz){l-^rz~^y 

where ocJ = i{(l -r)“ + 2Ar(l ~r)>* ± H(1 + »-)® '2Ar(l -f f)}h 
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a and p can be easily verified algebraically to be real. Then if J is a sequence of indepen¬ 
dent random variables with zero means and the same standard deviation, the process {r„} 
generated by the relation „ 


will have the same correlational properties as {A„}. 

We now consider what happens when we generalize the above to ‘processes’ with more 
than one ‘ time ’. As the idea of a continuing ‘ process ’ is now less applicable we shall call such 
a model a ‘ spatial stochastic system ’. We consider such a system to be defined if for any set 
of points Pj,..., Pj, in such a plane (or higher dimensional space) there is given a set of random 
variables and a corresponding joint distribution function , a;j.) which satisfies 

the customary consistency conditions that the joint distribution of any set of x’b, Xi,...,Xj, 
{p<h) is obtained from the joint distribution of by integrating out Xp^j_, 

This condition corresponds to the Ohapman-Kolmogoroff equation in the theory of processes 
with a single ‘time’. If the distribution function F{Xi, ...,Xjc)is invariant under any trans¬ 
lation of the set of points we call the system ‘stationary’, and if, in addition, it is 

invariant under any rotation we call it ‘ isotropic ’. If we only know that the first- and second- 
order moments of Xi,...,Xji. are invariant under such a translation (or rotation), we say the 
system is stationary (or isotropic) to the second order. In what follows we consider stationary 
processes, but the results obviously hold under the weaker condition also. 

Suppose the variates defined so that each has zero expectation and variance cr®. Con¬ 
sidering first systems in two dimensions we take two parameters t and ii to correspond to the 
‘ times’, and we then have a correlation function 


p{p,g) = correlation{a:{f,-a), x{t-\-p,u + q)}. 

It follows that p(P.g') = P(“P.-”9)» 

but it is not necessarily true that 

P(P.?) = P(P.-3) or p(-p,q). 

The latter relations would be true if the system were isotropic, but they are not a sufficient 
condition for isotropy. 

The natural generalization of processes with a correlational function (1) would be a system 
whose correlational function is 

p{p,q) = exp[-A(p2-l-g'^)*]. (6) 

As will be seen later it is easy to show that such systems exist. Now suppose we derive 
from a continuous system having (6) as correlation function, a two-dimensional discrete 
system defined by a system of variables where Z, m take integral values, and is 

defined by ^^+1 

= 1 x{t,u)did,u. 

' Jl Jm 

Following our previous argument we might expect that we should have a correlation 

function which generalizes (5), i.e. of the form (5) multiplied by a constant. That this is not 

true can be seen as follows. If the result were true, the covariance of Xi,„ and 

would be of the form „ r , , , oat 

Ke^p[-/i{p^ + q^n, 

where K is some constant and p, is not necessarily equal to A. It would then follow that 

T = exp [/t(p* -t g*)*] oov (X,,„, 
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would be iudepeudeat of p and q. Taking in particular the case (7 = 0, this is equal to 

T = du^axpipp ~A[(j> + <2- hf + (^s" 

= dij dtij^ dwaoxp {pp ~ A[(p + 4 - «i)® + (Ws “ 

A{(p+4~'Ji)_ 


Then 


dp 


''r~{{p+k-kr+i'u^~^xm 

If 71 > A the second factor is greater than zero over the whole range of integratitni with the 
possible exception of the points where %=%, and so the whole integral is non-zero, which 
contradicts the hypothesis. On the other hand, if /i < A we can choose p so largo that cn er the 
whole range of integration the second factor is negative, again contradioting the hypothesis. 
Thus this generalization of the previous argument breaks down. 

It follows that in oases where it is necessary to derive a discrete system from a. continuous 
one, in the above manner, it would be more convenient, if jicrhaps occasionally less realistic, 
to consider systems with a correlation function 

= expt-Al(pl-/4l5rl]. fb) 

It is easy to see that in this case the discrete process heis a correlation function 

A^A^exLp[-k\h\~p\l\l 


where 


and 


^ 2(A-l-he-^} ’ 


when neither k nor I is equal to zero. When one is equal to zero the formula is modified. 
Cases where correlation functions of this kind can plausibly arise are those in which we 
might attempt to study the relative efficiencies of various experimental designs assuming 
that soil fertility is a random variable with a spatial correlation of the fonn ( 6 ). 

The existence of spatial stochastic systems with prescribed correlation functions follows 
from the two- (or more) dimensional analogue of Khintchine’s theorem. This assorte that 
a necessary and sufficient condition for the existence of a spatial stochastic system v?ith 
a correlation function p(p, < 7 ) is that there exist a function W{x, y), non-decreasing in x and t/, 
such that _ 

P{P,9)==\ 6^=^^HW{x,y) 

J —coj —ca 


and 


/*03 ^CO 

dW{x,y) = 

J —CO J —00 


The sufficiency of this condition is easily proved by a simple generalization of K hinichine’s 
method (1934) of constructing a stochastic process whose correlation function is the desired 
om, whilst the necessity follows from a theorem of H. Cram 6 r (1939) (see also Ldvy, 1948). 

(», y) can then be found in terms of p(p, g) by a Fourier inversion formula and in partioular 
^ ^ isotropic, W^y{x,y), if it exists, will be a function, of {x’^+y*) only 

"f t- Motion (as paovad in 

” tSin L ' “ “‘'“’S' to take A . 1. Wn than verily that W[z, y) can 

j_ f® f" dudr 
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Comider i f ” f ” 

SttJ-ooJ-k, (l + x^ + y^)^ 

Write x = tooaa, y^taina, jp = acos/?, q~aain^. 

The above is then equal to 


? ^03 /*2 

27 rJo Jo 


2ir ^ ^ita coa (a—/J) 

da- 


(1+ty 


Now 


= -f 

27rJo 


- if, 


«> /* 27 j 4 piia gob a 

dt\ day 


Jo 

in 


(l + t®)** 


glia cos a 


(Whittaker and Watson, 1936, p. 364), and so the above integral is equal to 


Now it is known that 



(! + <*)» 


dt. 


?^tJ^{ta)dt aJ‘K{a) 

Jo ■(I+^“25r(f)'’ 


This formula can be obtained by putting p 
(1937, p. 201). But 

if.w-is) 


0, /i = J in formula (7'll-6) of Titchmarsh 
i 


and so the above integral equals e-^ == exp [ - (jJ® + . The above method of argument can 

be easily generalized to three dimensions and exp [ - A(p® + o'® + r®)*] can be shown to be 
a possible correlation function. This type of function gives a satisfactory representation of 
the correlation between velocities in certain cases of turbulence, and it may here be pointed 
out that the spectral theory of turbulence has recently been developed in a very elegant form 
by Batchelor (1949). 

By using an inversion formula we also see that in two or more dimensions, if the system is 
isotropic, W(x,y,...) will be a function of a;®+y®+... only, and by integrating first over all 
directions, we see that for isotropic processes the correlation function will always be repre¬ 
sentable as a Pourier-Bessel-Stieltjes integral of the type Jni'ui) tdF{t). 

Jo 


TbST OB THE EXISTENCE OF TWO DIMENSIONAL STOCHASTIC SCHEMES 

Another problem arises in practice when we are given a set of variates Zj_^ (i, j taking in¬ 
tegral values), and we wish to decide whether there is any evidence that these variates are 
spatially correlated. Such a case can arise, for example, in uniformity trials in agricultural 
research. This is the two-dimensional analogue of the problem of testing the significance of 
serial correlation coefficients on which a great deal has been written (for references see 
Moran, 1948 a). We give here a simple test for correlation between nearest neighbours which 
generalizes a method of a previous paper (Moran, 1948a). 

We suppose that we have mn independent variates x^j {i = 1, j = 1, and we 
define what seems to be a natural definition of a correlation coefficient between a:’s which are 
nearest neighbours. Write and = 
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and 


'11 


( mn 
2mn—m~nl 

/ mn \ 
' \2mn-m~n/ 


m n—l ft 

i.i 


The initial factor is conventionally introduced because there are mn terras in the denom¬ 
inator and 2mn —mi — w in the numerator. In large samples t could therefore be considered 
an appropriate estimator of a presumed correlation coefficient between nearest neighbours. 
As we are here only concerned with a test for randomness it is sufficient to consider a lest 
lining T alone. If the a;^ are independently distributed in the same distribution, thii % are 
all on an equal footing, and if their distribution had a finite second moment, the correlation 
between any two z’& would be (wm-1)-^. Without assuming, however, that any momenta 
exist, we have r m »-i . m-i n 'i 




I 




= („f S«?/’ 

\mn(m7i.-l)/ \ s4 


2 m«,—m—n 
mn(mn~l) ’ 


because = b- (The S symbol without suffixes is used above to indicate summation over 
all values of i and j.) 

To evaluate the second moment of I we have to assume further that all the Xy are dis¬ 
tributed normally. There is then no real restriction in taking the variance of to be unity. 
The denominator of I is then distributed as x® with ma-1 degrees of freedom, and since 
I is the ratio of a quadratio form in the to a quantity distributed as x® it follows that 
I is itself distributed independently of H^ij- We then have for any positive integer p 

p/Tv) _ -®(ttmneratQr of 

^ ‘ m4))^ 

But from the properties of the x® distribution we have 


- (mn-l)(mM+l). 

We now have to find the expectation of 


' m »—1 


m—1 n \2 


On multiplying this out we find terms of three different kinds. 

(1) Terms of the form zli42- The number of such terms is clearly equal to the number of 
]oms of nearest neighbours on the lattice, i.e. to {2mn-m~n). Moreover, by considering 
the charaoteristio function of the joint distribution of the g's we see that 


= (l + 2p2)(ri, 

where p is the correlation coefficient (‘mn- l)-i between any two a’s and 

0-2 = var (a) = (mw- l)/mM. 
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The contribution of terms of this hind to the expectation of the numerator is therefore 
{2mn — m — %) (1 + 2{mn — 1)~^) cr* 

_ {2mn ~m — n) {mV — 2mn + 3) j 
(mw-1)® ^ ' 

(2) The second type of term is of the form and it is easy to see (Moran, 1947, 

p. 323) that the number of such terms occurring in the square of the numerator is 

2{m{n-2) + n{m-2) + i{m~ l)(u- 1)} = 4{3mw-3wi--3n + 2}. 

Moreover, the expectation of such a term is (p + 2p^) cr*, and so the total contribution is 

4(3wn — 3ni — 2n + 2) (mn - 3) ^ 

(3) The third type of term is of the form typified by and corresponds to two 

joins on the lattice without common points. The number of such terms in the expansion of 
the numerator is (Moran, 1947, p. 323) 

AmV — 4.n?n — 4w»®+— 1 2mn +13m +13?i — 8, 
and the expectation is 3pV, so that the total contribution is 

3 

;- — 12mw + 13m + 13n — 8}tr*. 

(mw—1)2^ 

Adding the above contributions and dividing by (mn,— 1) (mw+1), we find 

2mV — mV — mV — 4mV + 2m% + 2mn^ — 2mn + 3m^ + 3n,^ 

' mV(mn--l){mn + l) 

and var jf is best found from the formula 

vav{I) = E{P)-[E{I)f. 

Higher moments of the distribution of I could be calculated in the same way using the 
frequencies of various combinations of joins given in Moran (19486), but this would be very 
arduous. If, however, the mean of the distribution of the x’s is known exactly, and rj^ and I 
defined using deviations from this mean, the formulae are considerably simpler. In both 
cases it is easy to show that the distribution of I tends to normality as m and n increase. 
It should also be noticed that a test, based on rearrangements, for randomness in an array 
of this kind has been given by M. N. Ghosh (1948). 
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ACCIDENT PRONENESS 


By major greenwood, E.R.S. 


[Editorial note. This paper was probably Major Greenwood’s last completed work. It waa 
submitted for publication on the day of his death, 6 October 1949. It is hoped to indmie some 
account of his life and work in the next issue of Biomeirika.] 

An eminent psychologist has written: ‘When during the last war two statiaticiang had their 
curiosity aroused by some accident figures in munition works, history wa^s made (feinith, 
1943, p. 183). Dr May Smith did not mean that these two statisticians were the first to remark 
that some people had clumsier fingers and (or) less alert brains than otheiu, a fact no doxiht 
commented on by the overlookers in manufactories of flint arrows in the old stone ago; she 
meant that they were the first {so far as at present known) to jiropose an arithmetically 
simple test, based on the accident frequency-distribution which would result if those (‘.xposed 
to the risk of accident, in an environment wliich did not change, had some human character¬ 
istic, later to be christened Accident Proneness, which was a continuous variable adiHiualely 
represented by a Pearsonian curve of type III. Were this true, then the distribution of 
0 ,1, 2, etc., accidents would be a negative binomial of the form 



r(r+l) r(r+l)(r + 2) 
2 Hc-i-!)*■*■ 31(0 + 1)2' 




where r and c can be deduced from the first and second moments of the distribution (Green¬ 
wood & Yule, 1920). 

This simple test interested psychologists and suggested to them the possibility of detecting 
persons prone to accidents before they had had any aooidents, The first thing to do was to 
apply suitable tests to persons who had been or were about to be exposed to the risk of 
accidents, and to learn whether the persons with high (or low) marks in the tests had. low 
(or high) accident rates. 

The first results of such an inquiry appeared in 1926 (Fanner & Chambers 1026), and 
several other reports have since been published by the same and other investigators; indeed, 
there is a large ‘literature’ of the subject, I do not propose to opitomizo the litoraturo, but 
believe that the following paragraphs fairly estimate what is now established. 

A large number of tests have been tried. Some of these are primarily measures of corporeal 
dexterity, others—at the other end of the scale—explore, mainly, the Qonative or the 
cognitive sides of human nature or, if the reader prefers, of the psyche. Results show con* 
olusively enough that there is a statistically significant correlation (measured, of course, in 
various ways) between performance in some of the tests and accident scores. Wo may there¬ 
fore hold not only that ‘ accident proneness ’ is a human ohaiacteristie, but that it is measur¬ 
able and that it is reasonable to believe that if persons whose scores in tests found to oorrelate 
Tnth accident scores in these researches were excluded from occupations involving special 
risk of accidents, the accident rate in such occupations would be reduced. But so fax no test 
or battery of tests, has been found which would exclude the highly accident-prone 
excludmg a considerable proportion of entrants who are not specially ‘bad risks 
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This difficulty is not peculiar to the study of accident proneness. It is found in all attempts 
at a priori selection of persons suitable for occupations. But it is a serious difficulty because, 
until it is overcome, it means that we cannot by purely arithmetical methods discover the 
true frequency distribution of the variable we call accident proneness, because we only have 
the distribution of accidents. We can only guess. We know empirically that a very large 
proportion of accident distributions give some of the criteria of a negative binomial, viz. the 
appropriate first and second moments of such a distribution. We know nothing more. 
E. M. Newbold (1927, pp. 604-5) in her classical memoir found in eleven instances that the 
proneness distribution was either in the type VIj or type Ij area for ten cases while for one 
case it was in the ‘ impossible area ’, when the first four moments of the accident distributions 
were used. She justly remarks that, owing to the large probable errors of the higher moments 
and the fact that tjqje III is at the dividing line of two areas, all one could say was that 
type III was a reasonable choice. Readers of Biometrika do not need to be told that because 
an aggregation of frequency distributions, made by summing the zeroes, the I’s, the 2 ’s, etc., 
of the separate distributions, give a negative binomial, the finding is no proof that proneness 
was responsible. We should necessarily reach a negative bmomial if the items so aggregated 
were Poissons—^unless, of course, they were identical Poissons (Pearson, 1917, p. 139). 
Some beginners have overlooked this. It may, perhaps, be worth noting that if the com¬ 
ponents aggregated—all O’s together, all I’s together, etc.—were Poissons, the variance of 
the resulting negative binomial will be smaller than it would have been if the several com¬ 
ponents were themselves negative binomials with the same means. 

There is an oddity about equation ( 1 ) as practically applied which has not been noticed. 
As the constants of the proneness distribution are deduced from those of the accident dis¬ 
tribution, they must vary from factory to factory if the external risk varies. But, by hypo¬ 
thesis, proneness is a character of the individual, a psycho-physiological property which 
exists whether he is subjected to the hazard of accidents or not. This did not affect the use 
of the method made by Greenwood & Yule, who assumed that in each factory the risk was 
constant, but it does make comparison of factory with factory difficult. Suppose then that 
we put the fundamental Poisson in the form 

g-)ex(l ^ jf-xji 1 ^ Pa;®/21 -f !...), (2) 

where lb is constant for any one factory or department of a factory, but different for different 
factories or departments. Then our accident distribution will become 

c^l(c -1-*)’■ (1 -h/cr/(c + A:) 11-1-Fr(r +l)l{c + k)^Z\...). (3) 

At first sight, this is merely trivial; if we write in (2) y = kx, we simply have a straight Poisson 
in y, and if we write ck for c in (3) we are back to (1). But it does make some comparison 
between different sets of data possible and admits of a process akin to the standardization 
of death-rates. Suppose we take an accident distribution, any accident distribution pro¬ 
vided it is effectively a negative binomial distribution with a mean m, and adopt this as the 
standard form, viz. assume its k to be unity. We take now another accident distribution 
having a different mean m' which again is a negative binomial. Now put k = m'jm and sub¬ 
stitute for the c of the standard form cjk = G. We shall have again a negative binomial having 
the required mean. Does this effectively graduate the experience? Trials on some of New- 
bold’s data (Newbold, 1926) showed that this very naive plan did not give bad results, but 
they were not at all convincing because the range of means was narrow. She had, however, 
one pair of observations from the same factory, a manufactory of sweets, where the length 
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of observations was the same for both sets but the means of accidents quite different. Tiie 
sugar boilers had an accident mean of 2-50 and the other constants were c = ()-eOOfl2, 
r = 1’62256. The department of chocolate moulding had an accident mean of with 
c=0-36462 and >■= 1-4366. Taking the sugar boilers as standard, k for moulders is and 
tbe c should be 0'3864, wbioh is not widely different from ite empirical value 0-38482, while 
1-4366 is witbin sight of 1-62265. Of course this is only what Darwin might have called a 
Tom Tool Experiment, but there may be something in the idea. At least, if the resulte of 
‘ standardization’ are widely discrepant from the observed results, it suggtwls heterogeneity. 

An obvious cause of heterogeneity is selection. The second column of I able 1 givM the 
observed values of accident frequencies in 166 London Transport bus drivers (first year of 
observation) studied by Farmer & Chambers (1939). The second column gives the expected 

Table 1. Accidents of 166 bus drivers in first year of observaCioti (Fanner & Chambers) 


No. of 
accidents 

Observed 

Expected 1 

Expaofcod 2 

Expected 3 

0 

46 

40-2 

60-3 

46-4 

1 

36 

46-4 

41-0 

41-7 

2 

40 

34-2 

28-0 

31-2 

3 

19 

21-6 

18-2 

2l)-7 

4 

12 

12-1 

11-2 

12-7 

6 

8 

6-4 

6-7 

7-1 

6 or more 

6 

6-6 

0-4 

7-2 


Expected 1 is obtained by fitting from the observed mean, and variance of the data. Pss 0-38 for 
4 degrees of freedom. Expected 2 is fitted by ‘standardization’; agreement in total and metm arc 
forced. P=0-19 for 6 de^eea of freedom. Expected 3 is fitted from the curtailed gamma function 
(the ganuna function which is asmmed to represent the proneneas of the standard {xipulation) and 
gives the accident mean of the observed data. P= 0-64 for 6 degrees of freedom. 


numbers when c and r were deduced from the observed mean, 1-81, and variance, 2-91092. 
The c computed by 'standardization’ on the sugar boilers was half the observed value, 
0-8397 instead of 1-6619, and the observed r twice the ‘invariant’ 1-6225. The observed 
accident variance was 2-91092, but ‘standardization’ required it to be 3-9727. The ‘ oxpooted’ 
frequencies, although not so good as those directly calculated, were not bad (third column), 
but evidently the variance is hopelessly large. The results ought to be bad. Bus drivers ar© 
a highly select population (I shall refer to it when I return from tlids digression); the variability 
in proneness of the exposed to risk must be less than that of the confeetdonery workers, who 
were certainly not so stringently selected. 

It is quite easy to determine the effects of selection, if proneness is obliging enough to 
have a gamma function distribution, thanks to the existence of Pearson's Tables of the 
Incomplete Gamma Function.* Taking the sugar boilers as standard population, tbe mean 
of the bus drivers is reproduced by a curtailment of about 16% of the frequency. 
Using this, the process just indicated leads to the third set of ‘expected’ accidents which 
is an excellent fit. The arithmetic amused me and may, perhaps, amuse the reader, but 
I do not suggest that it is of much practical value; I have in fact tacitly dropped the notion 


• The terms in (1) were obtained by integration of 
replaced by the appropriate I{M,p)’s. 


sneoesaive complete T functions; thoso must be 
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of a A constant for any one factory department, but changing from department to depart¬ 
ment. But if we take as standard population any population with a greater mean and 
variance than the population to be standardized, then—^provided the accident distribution of 
the latter is fairly well fitted by a negative binomial—^we should expect the process to give us 
a fairly good fit. Common sense, however, teUs us both selection of workers and differences 
of environmental risk are involved. After aU, we know nothing more than the accident distri¬ 
butions given by samples, and not very large samples, of two populations; too much room 
for guessing remains even for those whose algebra is better than mine. 

Since the publication of Newbold’s memoir, field workers have not bothered about a deter- 
minist approach on these lines and have used Newbold’s stochastic results. To these, with 
certain exceptions to be noted (see p. 28), httle has been added; it has, however, been 
pointed out that the algebra would have been simplified by working with factorial instead 
of power moments. 

CO 

Newbold defined statistical proneness as meaning that in unit population ^8/;^ = 1, the 

0 

accidents happening to the subfrequencywill be distributed by a Poisson law with para¬ 
meter A,., so that the ‘accident universe’ will be an aggregate of Poissons. What we have 
is a sample of persons from a universe so defined; from such a sample we can stochastically 
estimate the parameters of the ‘universe’. By definition, the best available estimate of the 
mean A is the mean of accidents. A, and it is easy to see that if N (the number exposed to 
risk) is so large that N—1 does not differ appreciably from N, the best estimate of the 
variance of A is the variance of accidents less the mean. In the particular case leading to 
equation (1) this is obvious. The variance of the gamma function is rjc^, that of the accident 
distribution, r/c^-l-r/c. If Af = A^-t-e^, where is a sampling error and if A^ and are not 
correlated, we have 

If some other variable, x, say the scoring of a person in a test, is correlated with his accident 
score, then 


These are the relations which have been most used by field workers, whose object has been 
to reach a test, or battery of tests, which correlates highly with A. 

The difficulty of non-comparability of data collected under different environments of 
course remains. Por instance, suppose correlations of test scores and accidents vary signi¬ 
ficantly between different studies. Is that due to selection? Dr Irwin has pointed out to me 
how that question could be answered, if one had rather more adequate numerical data. 
But the variation of what I have called external risk remains. Any statistics of accidents 
must contain a number of events which have no connexion with the personal qualities of the 
exposed to risk. We may safely infer from what we already know that the proportion is not 
large, but it must vary with the occupation. I suppose a minute—and objective—^record of 
cvcTy accident entered on the statistical statement might enable us to eliminate these, but 
it would be a statistician’s paradise in which such information was available. 

Between 1927 and 1941 no important additions were made to the field-worker’s statistical 
tools, but at least two mathematical statisticians pointed out that a negative binomial 
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distribution of ajcoidonts, although a necessary, was not a sutFicient condition for the validity 
ofthepronenesshypothesia (Irwin, 1941, pp, 102-5). For reasons given by Irwin (pp. 100 7; 
see also Greenwood, 1941, pp. 107-8), the alternative hypotheses probably need not be 
entertained when the question is of the kind of industrial accidents which have furnisluHi the 
data used, so far, by all field workers. 

In 1941, Yule showed that if ptoneireas, A, is not increased by increased length of expo.sunt 
to risk, then if we write for the mean accident rate over a time of exposure k, then 

is invariant with respect to time of exposure; then u>‘jx given by 

/Ik 

Chambers, however, found from the data of bus drivers that decreased with length of 
exposure, i.e, is changed by experience. For bns drivers in the first year ^ 1 );^ was 0-51H, in 
the fifth year 0'444. 

On the practical side much has been done in the last 20 years, especially by Farmer & 
Chambers. In their first report (1926) the subjects wore girls employed in covering or packing 
sweets, dockyard and R.A.F. apprentices; in their last report (1939) Imn driv(T« in (ho 
London area. These reports have certainly verified the existence of accident iironencHH and 
proved that this quality is correlated with the scoring of certain sensori-motor testa. Om^ 
may conclude, as Irwin put it (1941,p, 107): ‘ (l)That, apart from dvffeToniHJHboAww'n drivers, 
accidents are certainly occurring at random. (2) The absence of a significant difforonce from 
year to year rules out the hypothesis of increasing liability to accident due Icj pwfvioUH 
accidents.’ The reader will remark that the first report hold out more oncnurugeinent to 
job selectors than the last. The conclusion was reached then that 'the final weigl\kxi tx^ults 
show a difference of 48 % in accident rate between those above and those below the^ average 
in the tests’ (Farmer & Chambers, 1926, p. 38). The study of bus drivers led to the fefilowing 
conclusions (Farmer & Chambers, 1939,p. 36). Ifthewoistquartileoftestoes had boon elimi¬ 
nated the subsequent accident rate on the retained would be 7 % less than it actually was for 
the total. If not only the worst quartile, but any other drivers who had three or more 
accidents in the first year were eliminated, a reduction of 44 % of the exposed to risk, the 
improvement would have been 13 %. There is, of course, no inconsistency between the 
results. Dockyard apprentices and employees of a wholesale confectioner do not have to 
pass the rigorous tests endured by would-be bus drivers. The eliminating tests aro unlike 
those of the field psychologists, but they may well overlap them. Farmer & Chambore give 
the test scores of 128 of the 166 bus drivers. I find that the thirty-eight drivers who were not 
tested did not have accident scores significantly different from those of the 128, so we may 
regard the latter as fairly representative. 

I make the correlation between accident score and test score for the first and fifth years 
0>12 in each case; neither is ‘significant’ by itself, but, even assuming that there is really 
a positive correlation, its order of magnitude is too smaU to have much practical value if 
the regression is linear. Naturally what the field workers would like would be an unseleoted 
population of future motor-car drivers, all of whom are tested and all of whom are obliged 

to report every accident, however trivial. Outside a poUce state such a statisticians’ paradise 
is a dream—or nightmare. 
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ORGANIC CORRELATION AND ALLOMETRY 

By K. a. KERMACK and J. B. S. HALDANE, University Oolkge, LmvdGn 


In studies on organic correlation it is frequently desired to fit a straight line to show the 
general trend of the relationship between two variates. The residual scatter of the observed 
points about any such line is often due mainly to the biological variability of the material; 
and the errors of measurement may only account for a very small part of it. For sucli a ciw. 
the conventionally used regression lines are quite unsuitable, since here the terms dt'ponden.t 
variate’ and ‘independent variate’ have no real meaning. It would perhaps be more reason¬ 
able in our case to follow Karl Pearson (1901) and choose tho line which miiiiinixes, not the 
sum of the squares of the deviations of one of the variates as do tho regression lines, hut 
rather the sum of squares of the normal deviations of the observed points. This line is tho 
major axis of the correlation surface, making an angle 0 with tho x axis, where 

tan 2d == — —P - , (1 A) 

/^ 20~/*02 


tand = 


(Aao ~ /^oa) + P (/■^ 2 o ~ d oa)^3 


(IB) 


and was first suggested by Adoook (1878) from the rather different point of view of finding 
the best line when the errors of measurement of both variates are equal. For us it sufforK 
from the disadvantage that, while invariant under rotation of the axes, it is not invariant 
under change of scale. In practice it is the latter that is important, invariance under rotation 
being normally of negUgihle advantage. As suggested by Jones (1937) and Teiaaior (1948), 
a line invariant under change of scale may be obtained by considering the major axis of tho 
distribution of two variates expressed in standard measure. Then, since in this moaHure 
A 2 o = = I by definition, tand is also identically equal to unity, irresiJoctive of tho value 

of/til. 

Therefore, the equation to the line in terms of the original variables is 


y~y _ x~x 


This line may be called the reduced major axis. It may be seen that, not only is it invariant 
under change of scale, but, in addition, its computation, involves only tho sums and. the sums 
of squares of the two variates, the computation of the sum of products not being involved. 
A further advantage will be seen by a consideration of the standard error of the estimate of 
o'v/®'* equation (2) compared with the standard error of the estimate of tan d, which is 
involved if the major axis is fitted. These may all he obtained up to the order of by 
straightforward methods, as below. 

As in equation (1), but considering here the sample, with T the estimate of d, we have 

tan27 = ... 


and so 
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Now consider the standard error; we proceed as follows; 


(y(tan 2 y) _ 8m, 


'20 


tan 20 

Squaring and summing gives 




8m, 


02 


var (tan 2T) = 


^(/^ 20 “/* 02 ) 




_ .. \2 i“22 + /“ll 


/*11 i “ 2 O ~(“02 

(/*40 ~t f^Oi ~ ^/*22) 




+ 2 /{ii 


(/*13~/*3l) 
/*20 “■ /^02 




SO 


that var T = /* 02 )^+/*ii(/^ 4 o+/*oi~^/* 22 ) + ^/hi(/*i 3 ~/* 3 i)(/^ 2 Q /^n 2 ) 

<(/*20-/‘02f+4/*ll]® 


and so var(tanT) == F -—+1 + /(l + 7 — —^ ' C a'll 

^>“■11 L (/^ 20 '~ i “ 02 )* ~'V \ (/^ 20 ~/* 02 ) /J 

Vri 


4/^fl 


/* 02 )^ V\ (/^ 20 “/* 02 )^ 

takes the negative sign if tan 29 is positive. 


varT. 


(/‘ 20 ~j“ 02 )^ 

In the normal case (3), (4) and ( 6 ) reduce to 

var (tan 2T) = (1 — / 3 ®) (1 + tan® 20 ) tan® 20 


n 


(]^-p®)si^ 
^ ipH 


and 


var (tan T) = 

crtanz. = (^) 


( 1 —p®)tan ®0 
wp® ’ 
*tan 0 


Equation ( 8 ) in certain cases takes simpler forms. If p = 0 


var (tan T) = 


o-^ ~ O'® 




M. _ if rr^ ^ (T^ 

•2\2> 


and if 


= 00 , 


a: 


if o-®<or®, 


X 
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(3) 

(4) 

(5) 


( 6 ) 

(7) 

( 8 ) 
(9) 


var (tan T) = -—§-, 
np^ 

For the slope of the reduced major axis of equation ( 2 ), the sampling variance of s^/s^ is 
similarly obtained: 8{mjm^^) _8m^^ 8m^, 

f^ozl/^zo /*02 /“'20 


and 


Squaring and summing var 

1 * 20 / 

\8j 4'n.p2o \< 

In the normal case, equation ( 10 ) becomes 

w(i)=?| 

WJ or® 


+ 


Poi 2/^22 ^ 


Poi PioPoz, 


PiO I poi 9^22 \ 
,/*io ^02 PioPot, 


J- 


n 


( 10 ) 


( 11 ) 


Equation (11) is identical with that obtained for the variance of the regression coefficient 
in a bivariate normal population—a rather surprising result, due to Teissier (1948). 
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Table 1 gives the efficiency of tan T in terms of sjs^, as a percentage, in a number of ca«‘B. 
It can be seen from this that the use of the statistic derived from the major axis, rather than 
the other, always leads to a loss of efficiency, which can, if cr| and (rl are nearly equal, and 
the coefficient of correlation small, be enormous. 

Table 1. Oompansm of the accuracy with which the slopes of the reduced major 
axis and the major axis can he estimated 


var(tanT) 



The exact distribution of the ratio Sy(a^ is known in the bivariato normal caao, and is 
given by Bose (1935). It is 

1 ( 12 ) 


dF 


2(l-p®)i<™“b (an~i I 4p®(i>® 

“ p/u-l u-lUl + wa)™--^” (l + w®)=> 

\ 2 ■ 2 j 


S O' 

where w = pinney (1938) should be consulted for practical details as to the use of 

this distribution. The distribution of tan T is unknown. 

The sampling variance of y—StanT may be obtained as below. For a normal population 
S{y—setanT) = Sy—ienidSx—, 


so 


var 


(y - a: tan T) = i {o-y-cr^ tan 5)® + (1 -p) tan i9^2cr5, o-y +j 


(13) 


The sampling variance of (y—xsyjsj may also be easily obtained as below: 

HV-^Syts^) == 

so, for a normal population, 

vw{y~xsylp^) = ^ (1 -p) , (X4) 

a very simple result. ® 

AimOMBTBIO OORBBLATIOIT* 

In many oases of organic correlation it is found that the distribution of the variates is hetaro- 
soedastio and skew. Often, however, the distribution of the logarithms is homoscedastic and 
more nearly normal. Hemmingsen (1934) discusses this point at some length, and giv(^ many 
examples, In addition, it may be found that the htted straight line does not pass through the 
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origin. This may be due to a significant curvature in the trend of the two variates, and it 
may be more useful to fit a line of the form y = (allomotrio growth of Huxley (1932)). 
In almost all cases where this has been done in the past, one of the regression lines has been 
fitted to the logarithms of the data. For the reasons given above, it is suggested that con¬ 
siderable advantages ate obtained in many oases if the reduced major axis of the logarithms 
is taken. This may be done in a very simple way if the distribution of the logarithms can be 
assumed to be normal. 

The numerical examples given below will show that the accuracy of the results obtained 
is not very sensitive to deviations from normality. 

Let X = e^, y = ey, where X and Y are normally correlated; and let = cr^jx and Vy = o-yjy, 
in other words let lOOWj. and be the coefficients of variation. Then if 


exp [Zf + =s M{t) = moment generating function of x, 

x’' = e’’-^ = M{r), 


and so 

X = exp [Z - 1 - fo-y, 

(16) 


x^ = exp [ 2 Z -f- 2(Tx]- 

(16) 

Thus 

exp[a-y = l + v| 


and 

= log(l + « 2 ), 

(17) 

Thus we see that 

T%r = log(l+t;5). 

(18) 


o-TT bog(J+«5)J 

(19) 


if we take a as the slope of the reduced major axis of the X, Y distribution. As (19) is the 
ratio of two logarithms, either natural or decimal logarithms may be used in computation. 

It may readily be seen that the accuracy of equation (19) will not be very sensitive to a 
moderate deviation from normaUty of the distribution of the logarithms. 

Let ^==^=0, = 1+p, ^ = l-p, and let k^, be the other cumulants of the 

distribution of X 3 , xi, ... those of y. Let ^ and y be independent. Now let 


X = •>n+-^{^+y), 

Y == ocm+\ogfi+^{^-y). 

Then var X — cr^, var Y = a^cr^ 

and N(X - Z) (7 - 7) == ap<r\ 

So Z and 7 have correlation p, regardless of the higher cumulants of ^'and y. Then the 
cumulant generating function of Z is 

fas CO 

Kxit) = + 8 

frog 


ii) 




and that of 7 

and let 


r= 00 l(i0\r tf 

Ky{t) = {am + log+ 8^ (x,.-xy) 


X — e^, y — eX. 


a;r ^ fTX ^ e*(r)^ 


Then as before 
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80 that 
and 

Clearly, then 
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« == exp[m + |o-®3exp|^ 

^ = exp [2m + 2a ^]exp (aJ‘ 2 cry (Kr + O “jJ ‘ 

l + t;|= exp[^r»+ 's 




( 2 ' 


s/( 2 y 


and log(l + vI) = 0 - 2 + S 

r»s8 

r=»cio/^ CC^(T^ 

Similarly log (1 = *^ 0-2 + ~ ^ ^ ^' 

- 6(a -1) Kg(Ks +Xg) + fi(a + 1) XjlXa + Xg)} + • • • 


Putting X8 = (1 +p)57i, X4 = (l+p)*ya. ^-s = (1-P)’ri. = (1" 

and so on, we have 

log(l+iJS) ,r, , (a-l)(l+p)»7i-(a+l)(l-p)»rv 

+ g{7(a2-l)(l + p)2y,-7(«24-l)(l-p)*ri-6(«-l)(l + p)'’r! 

+ 6 (a 4 - 1 ) (1 - p)® 732 + 12(1 -p 2 )* y^yj] + 0 {(r>)J. 

Supposing yi, yj, yi, yj, eto., to be quantities of the order of unity, the first term of the 
correction factor is small with (a - 1 ) o' or (1 — p)* <r. <r is approximately the coefficient of 
variation, and will rarely exceed 0 - 2 , while a— L and 1 ~p are generally of the order of 0 ' 1 
or 0-2. Thus a® wiU rarely be out by more than a factor of 4 % or a by a factor of more than 
2 %. The most serious errors are likely to occur when a is fairly large, and p small. 

In addition, we see from equation (19) that if two variates with normally eorrelated 
logarithms'have different coefficients of variation, then either the axis is curved (i.e. a--h 1 ) 
and allometry must be suspected, or it does not pass through the origin. In biology there 
are a number of examples of the latter, amongst organs wliich do not appear until the animal 
has reached a certain minimum size, antler length in male deer being a case in point. In most 
eases, however, for two organs, both present in the embryo, the axis must pass through the 
origin. 

Further, from (16) and (16), it can he seen that 


= a;(l + t;|)-i, 


and 

Z = log3:-^log(H-u|), 

(20) 


F = logy-Jlog{l + w2). 

(21) 

Thus 

f.^X = \ogy-llog[l + vl) Pi4(l+4)] + 

(22) 


(22) givmg our estimate of logj^ by the insertion of the sample values. It should be noted 
that while mi and m, are unbiased estimates 0//4 and log (1 + m Jmi®) is not an unbiased 
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estimate of log noj.jg logmi-^log(l+m2/mj®) o^ log-\\og {\+The 

unbiased estimates have been derived in a separate paper*. They are, to an order n~^, 


and 


log 


loglog 




^2 

2 mi 2 - 


The correction to a is therefore 

Aog(l+i»2o//-«lo) y_ / Iog(l 4 -TOao/m;§) \ / __ 2 ^ ' 

Vog(l+/ioMi)/ \log(l + Wo2K|)/\ nmif 


It can be seen that aU corrections are normally quite negligible. The transformation of a 
grouped variate will introduce further bias, which again will be usually negligible. The 
reference quoted should be consulted for further details if required. These corrections have 
not been employed in computing the examples given in the present paper. 

The sampling variances of the estimates obtained from (19) and (22) can be obtaiued by 
substitution of the sample values in equations (11) and (14) above. The variance of 
exp (¥ — Xsyjs^), the estimate of p, may then be obtained at once by remembering that 

var(e®) = e^vara:. (23) 

The exact distribution given in equation (12) may also be employed. It is clear that in any 
case the allometry is significant if a is significantly different from unity. The method given 
by Finney (1938) is useful for testing in this case. Similarly, the ooefiioient of correlation p 
of X and Y may be obtained in terms of the correlation coefficient p' of x and y, 


xy = exp [A + T] 

== exp [A -f- A+ ^{(Tx +cTy- 4- 2pcr 
= X y exp {/)[log (1 + wl) log (1 + u® )]t}. 


Therefore 


log{l+p\Vy) 

^ [log(l + i;®)log(l + i;5)]l' 


(24) 


And since 


= log (1 


(26) 


the regression equations 
weU-known formula 


of the logarithmic data may be obtained by substitution in the 


y = 

/«02 



(26) 


Similarly, the major axis of the logarithmic data may be obtained if desired from equation 
(1), and the variance of tan T from equation (8). 

The sampling variances of equation (26) may be obtained by substitution of the sample 
values in the well-known results 

var 






n 


(27) 


/_ A 

varl«-±^a; 

\ ”^02 I 


n \ nj 


( 28 ) 


* It is hoped to publish this paper shortly in Biometrika, 
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A SHOBTEB method 

If and Vy become small, so that and higher terms of v may be neglected, then from 


equation (19) 


while in the same way 


o-y Vy 




O'x 


■ or-, 


(29) 

(30) 


'’x 

These results may be obtained in another way. 

If the correlation between the two variates be liigh and positive, and their relation 
approximately linear, then the appropriate straight line may be taken as a tangent to the 
allometry curve at the means of the variates. Then since 

y - 


and 


ax 

xdy 
* ~ ydx' 


Thus for the reduced major axis 


a 


_ 


yo-a: 


as in equation (29). For the regression lines 

X f CTy f Vy 

y o-„ ^ 

as in equation (30). 

This method does not apply to the major axis, since 

- vj) + vl + (vl - «^)^] X {-(a-lc- o-r) + g'r + icr%: - 

and the use of the short method is not recommended in this case. In all 


cases 


' = loggr—alog». 

The sampling variance of the estimates of 

iogy--~log*, and logy-p^log» 

may be obtained quite simply as below, For the reduced major axis 

^{VylVx) _ 2dmiQ 

^vl^x ni^Q nigj 

Squaring and summing for a normal parent population 

'fe) = l%(^''P'"+'>’x+Vl-2p\Vy), 


(31) 


var 


(32) 


While S 
so that 
var 


t|logy_^logsj = |[^l + ^logs)-<JS(l+log®)^-^^J^j Slogs], 
(logy-^logsj 

= ^[log’‘s(l-j!) +(l-p') j2(L + logx)(l+Jilogs]4-(l+p')^-2^ 

* ' \ / ^as 


(33) 
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For the regression lines _ ^9? 4 . 

P Vx «io 2 "»oi ^10 

and, squaring and stimming, as before, for a normal population 
Further, we see that 

^/log^—p'^log*^ — ^8yi\-<r^\og^ — Bxp'^-^^}.ogx+ 1) —d/p'Slog S 
\ “^x I 'y\— \ J '^x \ ^®/ 

squaring and summing 


(34) 


var^logi/-p'^loga:j = j[^(l-p'2)|l + l5^q.2p'JlogiBj+p'2^1+J^(l-2p')j . (35) 

In all cases, as in equation (23), var 6 = 6®var (log 6). 

It can be seen that equations (32), (33), (34) and (36) only reduce to those obtained in the 
exact case under the following conditions: the coefficients of variation should be negligible 
compared to unity and subequal, and, for equations (33) and (35), the coefficient of correla¬ 
tion should be large and positive. Under any other conditions the short method may give 
misleading results. 

Below, in Appendices, are given an Example and a summary of the main formulae 
developed. 


APPENDICES 
I. Illustrative eanmple 

An example will be given. It will be taken from a population of 338 specimens of Micraster 
cor-anguinum from the chalk of Northfleet, Kent. On these specimens the total length (Z), 
and the height to the apical system (it) were measured. Table 2 gives these results arranged 
as a correlation table. From an examination of this table it may at once be seen that the 
distribution is both negatively skew and heteroscedastic, while the trend of the observations 
shows a slight but distinct curvature. From Table 3 it can be seen that the correlation be¬ 
tween the two variates is high (0-8848), and that the fitted straight lines do not pass through 
the origin. Table 4 shows the data replotted as natural logarithms; the distribution now seems 
to be reasonably homoscedastio, although the negative skewness is, of course, increased. 
Table 6 gives certain relevant parameters for this distribution. In Table 6 the parameters 


Table 3. Micraster cor-anguinum. Parent population 


Apical height (A) 

Total length (I) 

Mean (A) = 30-903 mm. 

Variance (sj) = 21-93 aq.mm. 

Coefficient of variation 

x0-01(?;a)= 0-1616 

Mean (Z) = 60-078 mm. 

Variance («J) = 92-87 sq.mm. 

Coefficient of variation 

x0-01(e,)= 0-1924 


Coefficient of correlation (r) = 0-8848 ±0.0118 
s*/s, =0-4860 ±0-0123, Ti-{a^Bx)l = 6-667 ±0-623 mm., 

r(«»^i) = 0-4300 ±0-0123, Ti—risjsi) I = 9-370 ±0-632 mm., 
tan T = 0-4494 ± 0-0129, H —taxi Tl = 8-398 ±0-666 mm. 
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Table 4. Micraster cor-anguinum. Correlation table formed of 



Table 5. Logarithm population 


Logs of apical heights (JET) 

Logs of total length (L) 

Mean, (fl) = 3-4183 

Variance (8%) = 0-02862 

Mean (L) = 3-8914 

Variance (si) = 0 04476 


Coefficient of correlation (r) = 0-8866 ± 0-0116. 


Table 6. Micraster cor-anguinun). li — b¥ 


Method 

a 

b 

Regression of log h on log 1 (calculated from logaritlimic data) 
Regression of log h on log 1 (assuming normally distributed logs) 
Regression of log h on log 1 (short method) 

Regression of log 1 on log h (calculated from logarithmic data) 
Regression of log I on log h (assuming normally distributed logs) 
Regression of log 1 on log h (short method) 

Major axis (calculated from logarithmic data) 

Major axis (assuming normally distributed logs) 

Reduced major axis (calculated from logarithmic data) 

Reduced major axis (assuming normally distributed logs) 
Reduced major axis (short method) 

0-708 ±0-020 
0-701 ± 0-020 
0-697 ±0-020 

0-901 ± 0-026 
0-891 + 0-026 
0-890 ±0-026 

0-776 ±0-022 
0-767 ±0-022 

0-798 + 0-020 
0-790 ±0-020 
0-788 ±0-020 

1-94 ±0-16 

1- 98 ±0-16 

2- 02 ±0-16 

0-918 

0-944 

0-960 

1-49 ±0-13 
l-64±0-13 

1-37 + 0-11 
1-41 + 0-11 
1-42 ±0-12 


of the equation of allometry {y = y9a:“) have been computed in three ways: from the log¬ 
arithmic data of Table 4, from Table 2, in the one case on the assumption that the distribution 
of the logarithms is normal, and in the other assuming that the fitted straight line and the 
appropriate aUometrio curve are tangential at the means (short method). Results are given 
for the two regression lines, for the major axis, and for the reduced major axis. It can be 
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seen that the agreement between the results obtained by the three diiForent methods is very 
close, the results obtained by assuming the logarithms to be normally distributed being 
consistently better than those obtained by the short method. The marked negative wkewnesB 
of the logarithmic distribution seems to have had singularly little. elTecjt on the accuracy of 
the results obtained by the method assuming normality. In addition, the value obtained 
for the coeffioient of correlation by the latter method {0'880B ± ()-l)l 1 (i) .should be oompared 
with that obtained directly from the logarithmic data (0-8865 + 0*0116). 

Incidentally these results show the very considerable disadvantage tjf using regression 
to calculate allometry. The value of a calculated from the regre.ssion of /i on 1 is ()• 71, from the 
regression of Z on A 0-90, whereas O'80 is a more satisfactory value. 


II. Summary of formulae 
1. Fitting a straight line, y = ax+ b. 

(I'l) Major axis: 

a = tanWl + 4 tan 23* = , 


r 


6==y-5ctanT± \-{s^s^ianTf + (l~r')iax\T\ 28^s^+- 


a: tan T{ \ 4 -r')" 


L 




(1'2) Reduced major axis: 




(1-3) Regression line: “ 

Sx n 

2. Fitting allometry curve, y = bx^, assuming normally distributed logarithms 
(2-1) Major axis: 

tan 2T' = 


a = tan T 


'(l±i __ __ 

^ >‘'V TO /’ 

b = exp {log y - J log (1 + ,;a) - [log 5 - ^ bg (1 + «*)] tan T) 

^ * 7(2 + ^5) - HHl+ vl) tanT')® + (1 ~ r) tan log» (1 + 1 ;») log» (I 


u/ V 

\ 

^ [log X ^ ^ log (1 + tan d'( I r) 


(2-2) Reduced major axis: ^ 

Vlog(l + vl)\ “a/ to /’ 

6 = exp{logy-ilog(l + ,;J)-a[logi-|log(l + t,|)]} 

^ * “V {^~TO~^ (2 log (1+«|) + (1 + r) [log a: -f I log (1 + u*)])2| j. 


)) 
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(2’3) Regression line: 


a = 


lQg(l+rVJ ^ l( \og{l+vl){l-r^ ) 


log(l + i;2) \l\\ogil+vl) n I’ 


b = (exp {log 1 / ^ I log (1 + vl) - a[log ic -1 log (1+ •y|)]}) 


x|l± 

(2-4) Coefficient of correlation: 


(l-r2) 


n 


log{l+vg) 


^ (loga;-|lQg(l + ^;|)f 


log (1+^2) 


r = 


log(l+r\«;„) 


7[log(H-?;2)log(l + i)2)]‘ 


3. Short method. 

(3*2) Reduced major axis: 


b = (expjlogy-alog*}) 


(3-3) Regression line: 


2(l + log$) l+“log5| + 

\ ^S! 


(l+f')log^^ 


vA n 


6 = (exp (log y - a log a:}) 1 ± 




n 


1 + 


log®* „ , Vy , „ 

-^^ + 2r'-?^loga: + 




?''®|l+~^(l-2r') 
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THE PEOBABILITY INTEGRAL TRANSFORMATION WHEN THE 
VARIABLE IS DISCONTINUOUS 

By F. N. DAVID and N. L. JOHNSON 


1. It is well known that given a continuous random variable, z, distributed with demen* 
tary probability law, p(z), then the random variable 


-i: 


p{x)dz 


is distributed rectangularly in the interval [0,1]. This is, however, only true fur a coiiiimmts 
random variable a: with known probability law. In a previous iniblication (11148) we have 
discussed the effect on the distribution of y if the parameters of tho distrilmtum of * are jiof 
known and have to be estimated from a random sample of n observations. In the i)reHent 
paper we discuss the moments of the distribution of the transformed variable y whc*n z i.4 
discontinuous, first when the probability law of a; is known and second Avhen parainek'm t)f 
this law have to he estimated from observed data. In both these cfuscs, if p{x) be the dmnen- 
tary probability law of the discontinuous random variable, x, the tran8h)cuu‘<l vH.rin.ble, 
which we shall call v, where x 


wiU not be rectangularly distributed. The first of these cases has already been the subject 
of an arithmetical investigation by H. 0. Lancaster (1940). Lanoaskir suggested a modifioa- 
tion of Fisher’s test for the combination of tests of significance which has as its basis the 
assumption of lectangularity. This present investigation is carried out from a purely theo¬ 
retical standpoint and in so far as the topics discussed here are common with t hose of 
Lancaster’s paper, his empirical suggestions are confirmed. 

2. We consider a random variable x which may take any one of a finite set of k mutually 
exclusive values, which are also the only possible, with probabilities Pi,ps’ where 

k 

The transformed variable, v, may therefore take any one of a set of values Pj.*hPa, . 

Pi+Pi+ ■••+Pk> with corresponding probabUities pj, Pa,.... p^- From elementary oonsidor- 
ations we have t j . 

- 5 (‘+m) • 

The algebraic form of this expression suggests that we might redefine the variable, v. Thus 
instead of writing v as above we shall consider the variable w, where u is defined as 

i-X 

(i== l,2,...,fc). 

}“i 

P{u = uJ = p,. {i = l,2,...,fc). 


and as before 
We have then 
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The new variable, m, has thus the same expectation as in the continuous case. The second 
and higher moments follow from an application of elementary expectation technique. 


Thus 


/i-i 




i=l \i=>l / 

from which it is easy to deduce that 






1 fc \ 


/(«•) = i(l 


k 1 A; fc-l 

i=i 


S v\Pj 


K k K k 

oS?’?+oS?>t- 


lj=i+l 
11 * 


)■ 


k~l k 


Kft-l k 

•iS 


txSpI+ss 1,p\Pr 

K/c-l k fc-2 Jc—1 Ic 1 

-nS Epfph^^ S S . 

i=lj=i+ls=H-l / 

Correcting to moments about the mean we have 


K 


Ma(u) 


ipl+ilpt + 2^' S pIp^ 

i-i i=r i-ii-i+i 


)■ 




11 k lfc-l k k-2 k-1 k Ifc-l 

^ S p?- K S S pIp^- S S S p!pjPs- 2 S 

aOi=i i=l^=i+l8>=^+l - 




It is clear that as k, the number of groups, increases without hmit, the moments of u tend to 
those of a random variable, rectangularly distributed, which is to be expected. 

3. The moments of v may be obtained directly in similar fashion, or may be deduced from 
those of u. We give the first three of these for the sake of completeness, but have omitted the 
fourth because of its complexity. Thus 




^M-5( 

■) = 


i+JSjJJ+ss' I RP} 
1=1 1=11=1+1 




•f l:2>?+3s/i- 
^1=1 1-1 


Q k Q 

■5.5rf+4 




2 ft-1 k 

+ 3S 'E.PiPj 
i=li=l+l 

k ft-2 lc~l k 

, 8 . 


from which we deduce that 
cr\v) 


-V s P1P5+3S s s PlPiP. 


1 ^ ^ 


1 

^1=1 


KM 


2 *-1 k 

+ S S PiPl 
1=11=1+1 


k 0/fc 3 * \ 

/‘3(^) = -7Sp?+2SP?-2 I>P\+iXpU 

1=1 -^Vi-i ^1-1 / 


6 ft 
'41^1 


.3 


2 Qfc-~1 fc fc-1 A; 

+ is Sf>iip?-S PiP} 


fc~2 

+ 3S 

1-11 


fc-ifc 1/ft \8/ft'\/ft\ 3/ft \ /ft-i ft \ 

S S p\PiP,+j\ S2J? - Sp! -o SpI S S PiP)]. 

=i+l»-l+l 4\i=i / \i=,i /\i=i / ^\i=i /\i=ii=i+i / 
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4. Th,e moments deduced foi u and v above are quite general and will hold foi any discrete 
probabiUty distribution. The two discrete distributions in which wo are most likely to be 
interested, however, are the binomial and Poisson’s limit to the binomial. W e have therefore 
investigated for these two distributions the departure from reotangularitj' of the distribu¬ 
tion of V, as measured by the moment ratios a//9i s^nd The results of these numerical 
investigations are given in Tables 1 and 2 and are shown graphically in I* ig. 1. 


Table 1. VA and of the diatribntim of the transformed variabU u 
when the original variable has distribution fmiction {q + p)" 


p 

0-6 j 

0-6 j 

0-7 

0-8 

I 

1 (1-9 

1 

n 

2 1 

-VA 

0 

[ A i 

2-000 

-VA 1 

0-029 

1-802 1 

-VA 

0-213 

/^a 

b468 

-VA 1 
0-066 j 

1-601 ! 

-VA 1 

I'OOO 

A 

3-6-47 

4 

0 

1-831 

0-018 1 

1-841 

0-044 

1-866 

0-143 i 

1-066 1 

0-74(> 

1-6U2 

10 

0 

_! 

1-824 

I_ 

0-004 

_i 

1-824 

0-010 

1*826 

i 

0-060 ^ 

! 1-789 ^ 

i ! 

0-097 

1-892 


Table 2. and of the distribution of the transformed variable u when, the. 
original variable has a Poisson distribution with parameter m 


m 

0-2 

0*6 

0-8 

1-0 

1-2 

1-G 

1-7 

2-0 

VA 

A 

1-669 

0-686 

0-232 

0-136 

0-087 

0-064 

0-043 

0-033 

3-818 

1-681 

1-587 

1-697 

1-769 

1-810 

1-816 

1-H17 


We may note that as n->oo and p-)-1 but n(l-p) = m, the ^//?l and /4 of the binomial 
distribution tends to the values corresponding to the Poisson distribution with par am eter m. If 
p be fixed then, as n oo, each term (except the constants) in the expressions for the moments 
otu and V will tend separately to zero, and we ate left with the moments of the rectangular 
distribution as might be expected. Kg. 1 shows that the assumption of reotangularity for 
u may be very misleading, particularly when the asymmetry of the distribution of the original 
variable is marked. It will be seen from a study of the algebraic expressions for the moments 
of-a that the minimum departure from the rectangle moments will be when all the p/s arc 
eqqal, the maximum departure when all but one of the pfe are zero. 

6. R. A. Pisher’s apphoation of to the probability integral transformation oonsiate in 
noticing that -21og^'a is distributed as t two degrees of freedom, provided tt is a 
continuous variable. Thus if w© have r independent continuous variables %, .... u„ it 

wiU follow, owing to the additive jttoperty of x^i that 

-2 2^1og<,w, 

IS distributed as with 2r degrees of freedom. The moments of the distribution of a single 
discentinuous variable, -logeW, may easily be found. Por brevity we writ© 

k 


« (- I)" S p<[log, (1 -Pi- 


and we have 
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Using the linear difference operator H we may write 

or, since E = 1 + A e^, 

^(logeU)^ SPiei^‘^[log(l-r,)r ^ :EPiS Azi 7;J- - i Y,UogAl-rj]\ 

i=l i«l ‘■(IV—1)1 


45 




This, on snbstitution and rearrangement, becomes 


^(log,u)6 = S 




I \ TO—1 fc 

E3>?' 

i=l 


dF- 


/ * 

d S Pj 
\ip-¥l 


) 




This result may be reached alternatively by expanding #(loge'a) by the binomial and sum¬ 
ming along diagonals. The algebraic expressions for moments do not seem capable of expres¬ 
sion in any simpler form. From the expression for ^(logeW)^ it is possible to deduce the 
cumulants of the distribution, and hence, making use of the additive property of cumulants 
of independent random variables, to write down the cumulants of the distribution of the 
sum of r independent dis continuous random variables 

6. We now proceed to show that'as fc, the number of groups, increases without limit, the 
moments of — 21ogeM tend to those of with two degrees of freedom provided each of the 
Pi are different from zero. We have 


lim 

Pi-^0 

= 1 , 2 , ...,*!) 


<S’(logtU)’> = lim 'Epi logil- S Pi~-\p^ 

ft->oo <=i L \ y=t+i /_ 


Write 


(i 

SPr- 

1-1 


fc-^ 

Pi-^0 

®i-» 2, Aj) 


Zii and Pi = AZ^; 


(loggtt)* = S A^Jlog {Zi-\AZi)f. 


then 
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It is dear that we may ignore the \l\Zi inside the logarithm, since on expanflion thia will 
give rise to second-order terms in which wiU be negligible in the limit. Wo take then 

AZi->0 AZ 1 -+O 

Write ^ 


whence hin «f(log,M)^ = ( —1) I z e — ( 1)6*, 

k-^c£> J 0 

and therefore lim S'{ — 2\oggU)^ = 2*'6!, 

AZ(->0 

which is the 6th moment about the origin of the distribution of with two degrwH of freedom. 


Table 3. Actual tail areas of the probability distributions of u and v for the binomial 
{q+p)'^ corresponding to 0'06 and O-Ol levels in the continuous case 


n 

p 

0-6 0-6 0-7 0-H O-O 

2 

XS'Ot ■j.y 

X8.01 P 

0 0 0-00 0-0‘i O'Ol 

0 0 0 0'04 0-01 

0 0 0 0 (tni 

0 0 0 0 O'Ol 

4 

AOfOS 

/Uol p 

O'O025 0-0266 0-0837 0-0272 0-0623 

0 0-0266 0-0081 0-0272 ()-(M)37 

0 0 0-0081 O-OOlO 0-0037 

0 0 0-0081 0-0016 0-0037 

10 

XU p 
X2.01 p 

0-0647 0-0648 0-0473 0-0328 0-0702 

0-0107 0-0123 0-0473 0-0328 0-0128 

0-0107 0-0123 0-0106 0-0064 0-0128 

0-0010 0-0025 0-0016 0-0084 0-0017 


This result is true whatever 6. It may he noted that any function of the type 

S Pi~ApXX, 

i***! L \ J'-'i-M /J 

where d is a constant, will have the same limiting moments. 

7. The error involved in assuming that -21ogeM (or -21og,,u) is distributed as with 

two degrees of freedom was investigated numerically. We have 

Antilog. = 6 

for two degrees of freedom, and we choose e to be 0'06 or 0>01, these being the commonly 
used significance levels. It is accordingly straightforward to find the actual probability of 
« (or v) being less than 0-05 or 0-01, the formal significance limits. These probabilities are 
given in Table 3 for three different values of n and five different values of p for the binomial 
(q It will be seen that when n = 10, provided p is not too different from k P{u < 0-06) 
and P{u^ O-Ol} are not very different from their nominal values. 
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8 . We now turn to the distribution of the discontinuous random variable u, when the 
mean is fitted feom the data. For the Poisson distribution the mean determines all pro¬ 
babilities; for the binomial, {q+p)'^, n is often known, but the mean is necessary to determine 
p and hence the probabilities. We shall therefore discuss the moments of the function 


u 


1-1 

■ S Pi + iPi, 

i=i 


when the p’s have to be estimated from a random sample of N observations. 

It is assumed that the variable may take values x^, x^, (For example, in the binomial 

distribution these will be 0,1,2, — 1.) The sample consists of N units or observations, 

of which take the value Xi(i = 1,2,..., ft). We let the mean of the sample be X/W or we let 

n.^Xi + nzX^-\- ...-1-%% = X. 

Define the function X) as 

F,{x^,X) = y'LPj + \p}j . 

We shall write for brevity m-\ \r 

p;{.r,|X) = (^SPi+iPt). 

where indicates the value ofp^ as estimated from a sample with fixed mean X/X. We have 
that for aU samples 

^p,FM,X) = ^(F,(x„X)) = ^P{X}^{F,{x,\X)), 

l-l X 

the summation being taken over all the possible values of X. Further 


<^{FAx,\X)) = T,Fr{Xi\X)P{x^\X}, 


1-1 


so that 


^{FMt, X)) = s S pm P{x, IX} F,{x, 1X). 

X i 


For a fixed X the probability of getting a partition of N which is %, . n/^, is the multi¬ 
nomial chance wt 

which we shall write for brevity as P{ni,n 2 , It follows that 

P{x, I X} = 

where 2* means the sum over all possible k partitions of N when X is fixed. Substituting 

X 

this value in S{F^{x^ ] X)), we have 
We now write the multinomial chance as a product, 




and we have that Wa,= (X- l)'.p^ 

i.V *=1 Thg'. 

where the superfix (i) indicates that is to be replaced by — 1. Thus 


P{«.i,»2,...,n.fc} = X!n 

S=l7Xgi 
k 




(a) 

(/?) 


= _ 


pm pr 
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It 'will be remembered that x^, ...jij, are fixed values that the variate may take. Since X 

is fixed we know that the probability of a partition of N into k parte so that 


k 

n^Xf = X and — ^ 


is given by (a). We have in (/?) one variable missing from the f th group. Hence (/?) gives us the 
probability of a partition of N into k parte where 


It follows that 


= X-Xi and = W-1. 

j=.i j-i 


JS a»“l ^ 


and that 


= Pi. P{8uiD. of H — 1 variables = Z - a;^}, 


1 i 


S{FJXi 1 X)) = Fr{Xi\X).pi. P{8umof ~ 1 variables = Z-xj. 


Piljally on substitution in ^{F^(Xi, X)), we have 

(S’[Fr{Xi, Z)) = S ij 1 Z)p{. P{sum of Z ~ 1 variables = Z - x J 
xt»r 

= S X ( L Pi + iPil -Pi • P{sum of iV -1 variables = X “ xd. 

9. The theory as set out is applicable to any discontinuous variable, the elementary pro¬ 
bability law of which is defined by the values x^, x ^,with corresponding probaljititios 
PnPai • ••iPft' We now consider the special oases of Poisson and the binomial. 


(i) Poiason's binomial limit 

Assume that a sample of N ohservations has been drawn from a population which is 
described by Poisson’s binomial limit with unknown parameter nt. If the mean of the sample 
is XjN, then e-^lN{XIN)i 

where j may take values 0,1,2, ...,oo. The sum of jV-1 variables is itself distributed as 
Poisson -with parameter (N -1) m, and therefore 


xi-oV-o •/ tl (X-i)! 

Noticing that {N -1 , 

after a certain amount of rearrangement we have 


= X- 

X 


~Nm. 


{Nm)^ 




X! 


^■Jig the moments of the probability integral variable whose elementary probability law 
IS Poisson with mean estimated from the data. ^ ^ 
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(ii) The binomial 

Assume that a sample of N independent observations has been drawn from a binomial 
population (g+p)”', where the parameter n is known butp is unknown and must be estimated 
from the data. Here may take values 0,1,2,..., w. The sum of A’ — 1 independent binomial 
variables is itself distributed as a binomial variable with index {N — l)n. We have then 


and 


Pi 





s s 

A -£=0 




n\ 


!(?i—i)! 


,p^qn 








-JC-j-T- 


which on rearrangement gives 

n [i-l \rxn Nn-Xn 

X i=0 \^=0 / 

Thus, for any discontinuous variable, the moments of the probability integral variable can 
be worked out when all the parameters of the probability law are known except the mean, 
which is estimated from the data. From the expressions given it would be possible to decide 
what the size of the sample must be before the effect of estimating the mean can be neglected, 
so that the moments approximate closely to those of the distribution of the transformed 
variable when all the parameters of the probability law of the original variable are known. 
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HOW BALANCED INCOMPLETE BLOCK DESIONH MAY HE MADE TO 
FURNISH ORTHOGONAL ESTIMATES IN WEIGHINTJ DEHrtY- 


By K. S. BANERJBE, Ptw«, Bihar, Imlin 


1. SUMMARy 

Arrangements given by balanced incomplete block deaigiis may be uLilizeri as o{llei(‘n( sprhig 
balance designs (Banerjee, 1948). When these arrangements are used as sueli as neighing 
designs, it is not possible to get mutually orthogonal estimates. A metlu.d has been rletniled 
here to show how these arrangements may be made to furnish ortluigmuil estimates. 


2. Intbodxjgtion 

Let = + 1 , -1 or 0 , if the ith object at the ath weighing is placed in the hd't pan, right 
pan or in neither. Here i — 1 , 2 , ,..,p and a = 1 , 2 ,..., A (p^N). Let/;, he the weight of 
the ith object, fbe record of the ath weighing when the- weight is placed in the right pan 
(or the negative of the weight placed in the left pan) and a random variable <li.sti’ibuted 
about zero with variance (r^. The weighing of N linear combinations of p objects in a balunoo 
will then result in N linear equations of the form 

The matrix denoted by A = [a:„j] is known as the design matrix. Tho normal (‘cpiations 
giving the least-square estimates may be written in the matrix notation fWi j X'X ) B « X' Y, 
where X' is the transpose of X, £ and Y ate the column vectors FhOj... o,,} atrd ... (/.vl 

respectively and is the least square estimate of b^. The diagonal elements «*' of the reciprocal 
matrix [X'X]-^ will represent the variance factors, the variance of the ith object being given 
by The sum of the squares of the residuals divided by tho degrees of freedom (N—p) 
will give an estimate of cr®. 

The estimates are given hy _ [X'Xj'^X' Y 

liavft * 

[££'] = [[X'X]-iX'][[X'X]-iX7 = [X'X]-iX'X[X'X]-i«lXbYl b 

From the above it is clear that if the estimates of the objects arc available in mutually ortho¬ 
gonal Unear functions of the variables 14 (a = 1 , 2 , ,..,X), [X'X]”i will beadiaganal’raatrix. 
The constitution of [X'X]~^ will therefore rovoal if any of the estimates is nun-orthogonal 
to the rest. 

In a chemical balance, the object may be placed in both the pans so that the design matrix 
wiU have -f 1, -1 and 0 as its elements, but in a spring balance the elements of the design 
matrix are restricted to be either 4 -1 or 0. 

Hotelling (1944), the originator of the problem of weighing designs, has shown besides 
other things that the chemical-balance design of maximum efficiency is obtained when the 
design matrix X k orthogonal, consisting of +1 as its elements. Kishen (1946) pointed out 
that such a matrix can always be constructed when the number of weighings N = 2' (r any 
positive integer). Mood (1946) has pointed out that the construction of the chemical-balance 
design of maximum efficiency is connected with the Hadamard determinant problem and 
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has shown that the ohemical-balanoe design of maximum efficiency with N weighings exists, 
if the Hadamard matrix exists. Plackett & Burman (1946) have constructed all Hada- 
mard matrices up to 100 except 92. Mood (1946) has shown further that if a Hadamard 
matrix exists, the spring-balance design of maximum efficiency also exists. The order of 
such a design matrix is less than that of Hff by one. Such .designs have been denoted as Lj^. 
It has also been proved by Mood that when the number of objects p is odd and — 2jc—l, 
the most efficient spring-balance design is obtained when all possible combinations of the 
objects are weighed at a time. Such designs have been denoted by Mood as P^. The present 
author (1948) has shown that the arrangements afforded by balanced incomplete block 
designs furnish the same efficiency as the of Mood. He has also pointed out (1948) that 
the designs ijy are given by a special class of 83 rmmetrical balanced incomplete block designs. 
Kempthorne (1948) doubted whether the optimum spring-balance design of Mood would 
be practically useful in view of the fact that furnishes correlated estimates. Kempthorne 
suggested that fractional replicate designs which afford uncorrelated weights were perhaps 
preferable to the optimum design of Mood. The present author, however, showed (1949) 
that the design of Mood can also be made to furnish orthogonal estimates, and that these 
two t 3 rpes of designs are virtua lly of the same nature. In fact, a slight modification in one gives 
rise to the other. The nature of the original example of Yates (1936) has also been shown in 
the note referred to above. 

It is now intended to show here that the -arrangements given by balanced incomplete 
block designs in general may also be made to furnish uncorrelated estimates, and that the 
solution in the case of comes only as a particular instance of the general solution proposed 
to be discussed here. The identities of Fisher & Yates (1948) well known in the theory of 
balanced incomplete blocks, bk — vr, X{v~ 1) = r{k -1), have been freqilently made use of 
in the analysis in ooimexion with this note. 


3, When a balakobd incomplete block design is used 

AS SUCH AS A WEIGHING DESIGN 

Usually V and b are used to denote respectively the number of varieties and the number of 
blocks in balanced incomplete block designs. In weighing designs, v takes the place of p, 
the number of objects to be weighed, and 6 that of N, the number of weighings to be made. 
r and A, however, have similar meanings to those in connexion with balanced incomplete 
block designs; that is, r is the number of times each object is weighed and A the number of 
times each pair is weighed together. (The analysis henceforward will be written in terms of 
b and v instead of N and p.) The matrix [X'K] in general ivill take the form 


> A A ... A‘ 

A r A ... A 

A A r ... A 


LA A A ... rj 


( 2 ) 


(2) is of order vxv. The diagonal elements in the matrix reciprocal to [K'X] will be aU positive 
and equal to 

^ r4-A(t)-2) 

{r~X){r + A{v-l)yf, 


(3) 
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■while the remaining elements in. the reciprocal matrix will be all negative and espial to 

_ A 

(r—A){r+A(w—1)}‘ 

(4) shoiws that the estimates will be correlated. 


4, When- a balanoed incomplete block dksion is AO.njHTKn 

TO SUIT A BIASEI) SPBINO BALANCE 

If the balance has a bias, it will he necessary to modify the design matrix (o suit the 
estimation of the bias or that of the weights free of the bias. Taldng the bias a« an additional 
object to be weighed, a oolutnn of ones and only one row of xeroes in that nriler may be added 
to the design matrix to correspond to the bias supposed as an additional object. The design 
so obtained will then be suitable for the estimation of tiio weights. This means g<dting an 
estimate of the bias by only one weighing operation and Kubsecpiently weighing the com¬ 
binations of the objects along with the bias. If, however a column of oru»a and t row.s of 
zeroes in that order are added to the design matrix, this will imply devoting t weighings to 
the estimation of the bias. In such a situation, the matrix [AT'AT] will be of the form 


6 + i r r ... r 


r 

r 

r 


r A ... A 
A r ... A 


A A 




( 6 ) 


The order of the above matrix is one more than that of (2) because of the inclusion of the bias 
and is equal to (e +1) x (ii 4-1). 

I, The value of the determinant 


I Z'Z j = (r - A)«-i [(6 + <) {r+A{e -1)} - r^] 

= t{r — A)®-"^ {r+A(u — 1)}. 

II. The value of the determinant obtained after suppressing the first row and the first 
column of I X'X I is 

{r - A)”-^ {r +A(i> — 1)}. 

III. The value of the determinant obtained after suppressing the second row and the 
second column of [ X'X | is 

(r - A)”-® [(6 4 i) {^+- 2)} ~ r^v -- 1)]. * 

IV. The value of the determinant obtained after suppressing the first row and the 
second column of X'X ) is 

r(r—A)"-h 

thhdTOluJr^of obtained after suppressing the second row and the 

(r-A)'’-a{A(64f)-r»}. 

If the value of t be so chosen that 

A(l)4i)~f® a: 0, i.e. f = 

A 


( 0 ) 
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the value of (V) will be zero and that of (III) will reduce to i(r —A)’'“®{r +A(«^ — 1)}. Using 
(6) and the identities in the theory of balanced incomplete blochs referred to before, r—A 
may be shown to be equal to thXjr. The matrix then reduces to 

' 1 _1 _1 

t tk tk 

_1 JL 0 

tk tkX ■" 

tk ° tkX "• 


I tk ^ " - tkX\ 

(7) shows that except for the estimate of the bias, the other estimates will be mutually 
orthogonal. The estimates of the bias as well as those of the objects will be available as 


tk 

0 

0 


(7) 


[X'X]-^X' 


1 

1 

1 

0 

t 

t 

t 

1 

1 

1 

1 

tk 

tk 

tk 

r 

1 

1 

1 

1 

tk 

tk 

tk 

r 


( 8 ) 


For every 0 and 1 in all rows of X' except in the first, there will respectively be -1 jtk and 1/r 
in all the rows of (8) except in the first. The elements in the rows of (8) are the coefficients of 
in the linear functions estimating the weights of the objects. It is easy to see that the sum 
product of the coefficients in any two linear functions estimating two objects is equal to 

where.Ao = 6 — 2r+A. (9) on simplification may be shown to be equal to zero. 


6. Situation in a oomplbmbntab.y balanoed incomplete block design 

Given a balanced incomplete block design with parameters v, b, r, k, A, it is always possible 
to obtain another with parameters 

&(, = 6, rQ = b~r, k^ = v — k, Ao = 6 —2r + A, 

by replacing each block by its complement. Two such designs are called complementary to 
one another. The distributions of ones and of zeroes in X furnish the two designs, which are 
complementary to one another. 

When an integral value of t is available as given by (6), it is possible to get the orthogonal 
estimates also from the complementary design. In this situation a column of ones and 
t rows of ones in that order have to be added to the design matrix X to achieve the desired 
object. The matrix [Z'X] will then take the same form as (5), where r' — Tg + t and X' = X^ + t 
are substituted respectively for r and A. The value of the determinant obtained by suppressing 
the second row and the third column of [ X'X ] in this case will be given by 

{r'-X')'>-^{X’{b + t)-r'^}. 


( 10 ) 
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It is easy to see that (10) vanishes, as 

A'(6+1) - r'* = (Ao+f) (6+f) - (ro +1)** 

== {b-2r+A+t)(b + t)--[h-r + tf 
= 0, by (6). 

It can easily be shown by using (6) and the parametric relations that 


r'^tk, A' 


A(ikf 
»-2 ’ 


and r' +A>~ 1) - ifcjl +. 


The matrix [X'X]~^ in this situation will then reduce to the form 

^ -i -i ... -i 

r r r 

r 


T 


0 


tkA 


0 

0 


0 0 


r 

Wa 


1) 


where ^ ^ |l + — 




The estimates of the objects will be given by 


f-l 


tk 

tk 


i. 

ik 

tk 


tk 

Jj_ 

tk 


6-^0. 

r 

_1 

f 

r 




(p- 


. ^*0 
r 

1 

r 


tk 


1 

ik 


( 11 ) 


For every 0 and 1 in all the rows of X' except in the first, there will resiwctively be - Ijr 
and Ijtk m aU the rows of (11) except in the first. The sum product of the ooefficionto in any 
two hnear functions estimating two objects will be exactly the same as (9). 

t may be noticed that the variance factor for an object in the complementary design will 

be the same as that ofthe original design. J » 

th!t aymmetrical balanced incomplete block design,« - I, so 

thfhi^ r f^ "dded to the design matrix to suit the estimation of 

i is two f “ote referred to before (Banerjce, 1949) in respect to 

therefore, obtamed as a special case ofthe general procedure outlined here. 

6. Solution op a more obneeal nature 

is not an integrJ 

A - l.Wli6nr'ianotiri»M»v.‘"T ‘‘"’'STer, always exists tor aU designs when 

hy A 4- £. If a column of ones ^ <3an find the least integer g such that (r+ g)* is divisible 

on to the design matrix to ‘tTif ^ ^ ^ 

[Z'J] will be of the same fom al (6 )'wherTth^balance, the matrix 
lorm as (6), where the left top element will be 6 + g+ 1 ;, andf and A 
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will respectively be substituted by r" = and A" = A+|. The value of the determinant 
I X'X I obtained by suppressing the second row and the third column will be equal to 


Now (12) = 0 if 


(/' _ x.y~^ ((5 + (A +g) - (r+ y]. 
(6 + g + ^)(A+f)-(r + g)a = 0. 


( 12 ) 

(13) 


Knowing that (r + is a multiple of (A + ^), the value of t] will be determined by the con¬ 
dition (13). 

The results corresponding to I, II, III and IV of § 4 redirce respectively to 


(r - A)’' (6 -H C-l- V)y (>■ ~ {r -f A(t) -1) -I- ^ v }, 
{ r — X)'^-'^{b + ^+ 7 l ) and (r + g) (rA)""^. 
The matrix [Z'X]"’- will therefore be obtained as 

-A -G -G ... -0- 

-0 -L- 0 ... 0 

r —A 

-G Q ^ 0 , 

r—A 


-G 0 0 


where 


f-HA(a-l)-hgt> .r + g_ 

{b + ^+7]){r-A) {b + ^+7i){r-Ay 


The above matrix is of order (v-l-1) x («-l-1). The estimates of the bias as also those of the 
objects will be given by 


[X'Xr^X'Y 


')] terms g terms 

D. ..D A...A E E E 
F...F -G...-G FEE 

E. ..F -G...-G E F -G 


The column vector 
of the records of 
weighings, which 
are (6-I-^-1-7/) in 
number 


(14) 


where 


D = A-vG, E = A-W and F = -0+ 


r — A' 


For every 0 and 1 in all the rows of X' except the first, there will respectively be E and - 0 
in all the rows of [X'Z]~^Z' of (14) except the first. The elements in the rows of the matrix 
X' are the coefficients of the records of weighings in the linear expressions estimating 
the weights of the objects. 

The above analysis shows that the more general class of balanced incomplete block designs 
may also be made to furnish orthogonal estimates. It is also possible to get orthogonal 
estimates from a design, which is complementary to this design. To do this we add to the 
design matrix 7/ rows of ones and ^ rows of zeroes instead of adding £ rows of ones and 7/ rows 
of zeroes as was done in the former situation. The proof follows from the fact that 


(6 + 7/ + ^) (Aj-t-7/)-(7-o-f7/)® = (6-|-7/-t-g)(b-27--l-A-t-^)-(6-7--t-7/)‘* 

= 0, by (13). 
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7. NuMEBIOAL ir.r-USTBATIOJ«S 
The design matrix X in an L, (i.e. in a aymmetrlcal balanced incomplete block <l(*aign afforded 
by t) = 7 , 6 = 7 , ?• = 4, = 4, A = 2) is given by 

p 0 1 0 1 0 1“ 

0 110 0 1 1 
0 0 0 1 1 1 1 

X = 1 1 0 0 1 1 0 

0 11110 0 
I 0 1 1 0 1 0 

_1 1 0 1 0 0 1 

where the rows refer to the weighing operations and tlio cohumis to tlio oirjecfcs b^, 
to be weighed. 

' Seven sma.n copper pieces have been arbitrarily cho.sen as the olijccte for tlu; purpose of 
this illustration. The results of weighings (in grams) of tlic cninl)inalion.s of ol»jeet« a« given 
in the above design matrix are 10-76261, 7-83798, 6-U380, 12-07808, 8-90462, U)-63866 and 
12-80768, (The fifth decimal place of these records has b«>n deUtrniinnd by flu* unethod of 
oscillation, and no temperature and vacuum corrections have Imen matUi ivs the purpose was 
not to find the accurate weights of any specific objects.) 

The left-hand side of the normal equations will bo given by a square matrix [ X'-YJ-of rmler 
7x7, whose diagonal elements are 4 and the elements elsowhero are 2 , The right -liand side 
(i.e. the numerical side) of the normal equations is given by 

= 46-28683, = 41-62826, Z^ « 38-14367, Z^ 38-4(5466, 

5^5 = 37-86891, 26 = 36-66842 and 27 = 37-52197. 

Subtracting from each of these one-eighth of their total, and dividing by 2, the catimatee 
are obtained as 

= 6-86763, Sj = 3-62836, = 1-78600, 64 = 1-94650, 

65 = 1-64367, Sg = 1-04843 and $7 = 1-47520. 

The matrix [X'X] shows that the estimates are correlated. They may, howovbr, he obtained 
as orthogonal functions of the records of weighings, if the weighings are made in a biased 
spring balance. It has been pointed out in §6 that in the case of = 1, so that a column of 

ones and only one row of zeroes have to be added (in that order) to the design matrix in order 
to get orthogonal estimates. This means that the measure of the bios of the spring balance 
has to he obtained by only one weighing operation and the remaining cambinatioris have to 
he weighed as such in the biased balance. The records of weighings and the modified design 
matrix are shown below, the bias being denoted by ig. 

bg 6j 62 bg b^ 6jj bg 67 g. 

10000000 = 0-00101 
11010101 = 10-76379 
10110011 = 7-83990 

10001111 = 6.11680 (16) 
1 1100110 = 12-08000 
10111100 = 8-90543 

11011010 = 10-63998 
1 1 1 0 1 0 0 1 = 12-80998 
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The solution of the normal equations giving the estimates is straightforward. The 
constitution of the matrix IX'Xy-^X'Y assists in appreciating how the estimates are 
obtained as orthogonal linear functions. On substitution of the values of tjie parameters, 
tills matrix reduces to 

■ 1 0 0 ... 0 ■ 

+i ... +l 

••• +i 

.-i +i +i ... +i 

The above furnishes the estimates as 

S„ = 0 - 00101 , Si= 6-86790, Sg = 3-8286^, S 3 = 1-78558, 

S 4 = 1-94662, Sg = 1-64364, Sg = 1-04887 and S^ = 1-47676. 

The calculation leading to the solution may be simplified as follows: 

Let — 1 be put for every 0 in all the columns of the matrix (15) except in the first. The 

columns then consist only of +1 and — 1 as their elements. The algebraic sum of the records 

of weights corresponding to the minus and plus signs of a particular column divided by 4 
(i.e. k) will give the estimate of that object which the column represents. 

The balanced incomplete block design given by 

r = T, V = 8, k = i, 1) = 14, A = 3, 

will not furnish orthogonal estimates when used as such as a spring-balance design. Here, 
also, orthogonal estimates may be obtained, if the design matrix is modified to suit the estima¬ 
tion of the weights in a biased spring balance as suggested in § 6 . In the present instance, 
^ = I, tj =■ I, Records of weights and the modified design matrix are shown below. An 
additional copper piece was taken to make the number of objects equal to 8 . 

^0 ^3 ^4 ^6 ^6 ^7 ^8 S ' 

111111111 = 18-91670 

100000000 = 0-00101 
11111000 0 = 13-12036 

111000011 = 12-49119 

110100101 = 10-32320 

1 1 0 0 1 0 1 1 0 = 10-32997 

1 0 0 0 0 1 1 1 1 = 6-79780 

100111100 = 6-42631 (17) 

101 0-11010 = 8-59600 

101101001 = 8-68860 

111001100 = 12-07940 

110101010 = 10-76320 

110011001 = 11-08093 

100110011 = 6-83861 

101010101 = 8-16469 

101100110 = 7-83968 


The column vector 
of the 8 records 
of weighings in 
( 16 ) 


( 16 ) 
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When the iiiini6ric£il values of the paraifleters are suhstituletl) the lUfttrix [X X] X 3f 


takes the following form: 


7 

9 

1 

1 

“Tf 

18 

la 

Itf "* 

+ 1 

8 

+ 1 

+ J - 

+ 8 

“1 


+ 1 - 



Tho column vector 


of tho If) rocords 


of weighings in 


(17) 

w 


The estimates are obtained as 


0-00132, Si = 5-85791, S2 = 3-52807, S,, = 1-78583, .1-94731, 

1-64865, Sg^ 1-04861, and l-629«n. 


Here, also, the calculations may be simplified a« in the above instance. In this vm\ the 
algebraic sum has to be divided by 8 instead of 4 to get the ('stimate.s. 

No attempt has been made here to estimate the error from the oh.H(*rvation8. There will 
be no degrees of freedom left for the estimation of the eiTor variance in (;n«D of Lp as only 
seven observations were utilized in estimating the weightii of R(‘.ven ohjcclR. Only 1 and 
7 D,?. will be available for the estimation of the variances in the other two illuHtrations. 


The numerical illustrations have been added subsequently to this note aeotirtling to the 
suggestion of a referee, to whom my grateful thanks are due. 
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THE POWER OE THE f INDEX OE DISPERSION TEST WHEN 
NEYMAN’S CONTAGIOUS DISTRIBUTION IS THE 
ALTERNATE HYPOTHESIS 


By G. I. BATEMAN 


1. The index of dispersion is commonly used to test for the equality of variance and mean 
under the h 3 rpothesis that observations have come from a Poisson population. Thus if there 
are N random independent variables each following the same Poisson law, it 

is known that the quantity 

S 

2 = - ( 1 ) 

X 

is approximately distributed as A — 1 degrees of freedom, The exact distribution of 

z is not known. Hoel (1943) found the first four moments of the distribution, using Pisher’s 
^-statistic technique. If m is the population mean of the Poisson distribution, he showed that 
the moments of z are 

12(Jf-I)[w+3 + i + A,+ 


where the terms in square brackets are correct to lj{Nm)^, IjNm, and 1 /(Aot)" respectively. 
Hoel carried out a numerical investigation and reached the conclusion that for m > 5 the 
•}^ approximation to the distribution of z is highly satisfactory, even for A, the number of 
observations as small as 6, and is fairly accurate for to < 6 , although it will tend to give too 
few significant residts. 

2 . Suppose now that the probability law of the observations, *, is represented by Ney- 
man’s contagious distribution. This may be written as 


1 == 0} = exp (—mi(l — e-™*)) 


(fori= 1,2....,A;< = 0,1,2,...), (3) 


where 


TOiTOji = /ti, 

TOiTO 2(1 +TOa) = /ia. 


When there is no ‘ contagion’ present in the material observed, then 


TOi->-oo, TOa-»-0 and TO^Wa = to. 



gQ Power of / index of dispersmi test 

the distribution becoming that of Poisson with parameter, »i. The mcmnmts of ttm imlex of 
dispersion, of (1). under the hypothesis deseril)ed l.y (3) may be found using the hhiuc 
technique as did Hoel. Thus wo have 






1+1%- 




2?n| 


_ 13 __ . 3 _ *- - 4 -, 


Nmpn^ 
?%(2+m2) 


= [2(1+1%)*+ 


+ -( 


{Nm-pn^^ 


uij Nm- 

■ 10i«2~ 20»«a+^*”1+ f 


2+ Him, i ISml ! 2m| i 


mal'i '?»!) 


miWa 

-h Am^ \ m\ 

nix Wg 
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(iM 


{N~\) 8(l+m2)®+^^j^^l+ 12m2 + 20m| + 9m| + m| + 


i%(4 + Hmg + ml) 


■inixin.^ 


+ 


Nm- 

m|(9 


A 6 > * 

--(8 +60m,+ 1037^1+ 57m| + 8mi-i (79 + 2 iH7«2 5 imirn® i-24m|)) 

imjX 27(iim2 / 


I ~ Sm^) ”1 
2 (miW2)* ■■'J' 

+ 12{2i^~l)r4(i+mj)'^+- ~ -{6 + 60m2+1477n|4 13(imi) +4S>»4 1 tt;n|) 

L nqina 

^ (4 + 108m2 + 094m| + 828ml + 37 IihI -I- 72ml i 4m|) 
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+ i 


m. 


I (8 + 56m2 + 48m| + 257n.| + 9ml) 


+ . 


(4) 


(S) 


12(mim2f 

If we put wia = 0 and nixm^ = m these moments reduce to tiiose given in (2), 

3. These expressions for the moments of z are complicated in form, but tiu'rn is an im¬ 
mediate simplification if either or N, or both, is suffieieiitly large. The first four 

moments, as well as being correct to terms of order iV"*, N' iv’“ and N, resixudively, are 
also correct to terms of order (Wimj)"*, (mimj)”*, {miin^)'^ and (iiiiWi,,)®, reapectively. 
Hence, for Wima sufficiently large, we shall have 

/ii(g) = {N~1){\ + Wg), %(z) 4= 2(i)^ -1) (1 +m2)\ 

%(2) 4= 8(JV -1) (1 + ma)*, %(«) + 12(JV -1)* {1 + 7tta)'' + 48(iY ~ 1) (1 + 7 / 1 ,,)< 

These are the moments of (1 + Wa) y*, where has iS^ -1 degrees of freedom. We may fwsumo 
therefore that for Neyman’s contagious distribution the index of disiKirHion is diHtriluJtod aa 
X*(l+ 1 x 2 ). provided the population mean is sufficiently largo. It often happeuH in Imcterio- 
logical work that this is the case (see, for example, R. A. Fisher, ;^kttisHml MellukU for 
Besearch Workers, §16). In field ecology, when, counts are made on an abundant species, 
and the quadrat used is not too small, this condition is again realized. 

4. If JV is large then, regardless of the size of we have, from the first two equations 
of ^ * 

and ^i(z) and tend to 0 and 3 respectively as N increases without limit. Thus we may 

assume that _ ,,«■ t,., . , 

z-(iV~l)(l+ m,) 


^2(A'-l)(l+m2)*^l + 


1 ^ 2(2 + Wj) 

21747712(1+ma)* 


))‘ 
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tends to be normally distributed with zero mean and unit variance as iV -> oo. If, in addition, 
is large, z-(iV-l)(l+m 2 ) 

(l+mj)(2(JV-l))i ^ ^ 

tends to be normally distributed with zero mean and unit variance. This last is of course 
another way of saying 'that, &aN-^oo, where has JV-1 degrees of freedom, 

tends to be normally distributed. A closer approximation will be to make use of the fact that, 
for large N, ^l{2x^) tends to be normally distributed with mel^n .^[2(JV—1) —1] and unit 
variance, and we have in fact used this approximation below to 'obtain 

P{(l + m2)x*>yioB}. 

when N > 100 and xtos is the value of x^ 'with iV --1 degrees of freedom cutting off 0-05 from 
the right-hand tail area. We note further that (7) differs very Uttle from (8) even when Wjmg 
is not large, the difference in denominators being less than 5 % for = 6 . Thus if N is 
large, even if m^ma is not large, the distribution of z should be well approximated by that of 
(l-t-ma)x’*. 

6. Calculations were carried out with a view to determining how large should be, 
when N is not necessarily large, and is given, for the approximation based on the 
moments (6) to hold. The ratios of the fii’st four moments of z to the corresponding moments 
of (1 -f mg) x^ referred to as R^, R^, Rg, R^, respectively, and the values of these ratios for 
certain values of mg and N are given in Table 1. From a study of this table we notice 
that in no case do the first two moments differ greatly from those of (1 -t-mg) The most 
extreme case shown is that for which Wj mg = 6, mg = 2, and iV = 6 and in this case the means 
differ by 3 % and the standard deviations by 8 %. In stud 3 dng the ratios R^ and R^ it should 
be borne in mind that /5i(y*) 0 and 3 as W co. Now 

P2 p 

= and Aa(2) = 

and it follows therefore that ^^(z) -> 0 and p^{z) -> 3 as iV -> co, since -> 1. Thus although 

i ?3 increases with N, yet the point for z, if W is large, will be close to that of y® with 

W — 1 degrees of freedom as we have pointed out previously. We regard the position as 
satisfactory for N ~ 50 and mi mg = 6 and m^~ 1. For the same N and larger mi mg or 
smaller mg the position will be even better. 

6. As pointed out above, Neyman’s contagious distribution of (3) may be re,garded as 
depending on two parameters mi mg — m and mg, where 1 -j- mg is the ratio of the variance to 
the mean. If mg = 0 and m is fixed it becomes the Poisson distribution. Suppose now it is 
wished to test the hypothesis that mg = 0 against an admissible set of alternative hypotheses 
defined by (3), using a significance level a. We may do this by using the index of dispersion, z. 
The power of this test with regard to a specific alternative defined by mg = will then be, 
approximately, P{z^)d\m^ = M^} P{{l + M^)X^>Xl}> (9) 

where follows the standard distribution with W — 1 degrees of freedom and xl is f h® signi¬ 
ficance level a of standard tables. Fig. 1 shows the power obtained in this way, plotted against 
(1 -I- mg) for a number of values of N. The curves must be read bearing in mind the restrictions 
imposed in approximating to the distribution of {l-|-mg)y®. For N = 60, and upwards, it 

* It is doubtful whether the order of approximation used in obtaining the moments of z is sufficient 
to give JJj and to first decimal place accuracy for cases where {miini) is small and Wj large. These values 
should therefore be treated with reserve. They have been included because they serve to show the general 
trend. 
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Table 1. Phe ratios B„ B„ B„ B, of tU first four nummts of the Fomon indc,r ^ dispersion z, 
to Ike corresponding moments of (l+m,)x^ where has S - I nffrudom. Phe 

probability law for the observations is Neyimn'a contayiom distnhutwn iriih 111 ^ 171 ^, 
~ m^rngll+mg) 
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1-47 

1-49 

0-9960 

1-014 

1-24 

1-23 

1 0-9983 

I-1MJ7 

M2 

i I'll 


60 

0-9971 

1-066 

1-62 

1-32 

0-9687 

1-032 

1-31 

1-16 

0-9093 

l-«l« 

1-16 

1-07 


100 

0-9987 

1-077 

1-67 

1-26 

0-9993 

1-038 

1-34 

M2 

0-9997 

1-022 

M7 

! I'Oe 


00 

1 

1-0889 

1-7237 

1-1867 

1 

1-0444 

1-3696 

1-0900 


1-0222 

M793 

1'044( 

1 


will be seen that we are oonoerned with only small 'values of wig. It iniKbt therefore safely 
be assumed from the evidence of Table 1 that those power ourves will be a good representation 
of the power of a when the mean is as small as 6, and for even smaller means as iV increases. 
For the curves for small values of N, i.e, 5, 10, 20, the mean must bo large for the 
approximation to hold, unless Wj is small. For high values of mg, i.e, when the 
power is large, it would be necessary (vide Table 1) for wiiWg > 20 for this part of the curves 
to be accurate. Apart from these restrictions, we may note that the power is independent of 
the mean of the population. 


7. The (1+mg) xf approximation to the distribution of z is simple to handle and can readily 
be used, before the coUeotion of data, to assess the size of sample required in order to have 
a given chance of detecting a departure from randomness due to clustering of Neyinan’s 
contagious kind. Thus, using the 5 % significance level, a sample of ten observations from 
a Neyman’s contagious population will only enable departures from the Poisson to be 
detected nine times out of ten when the variance of the distribution is actually four times 
t e mean, n order to detect a 2; 1 ratio with the same probability it is necessary to have 
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a sample of between thirty and forty. Large numbers of observations, but not large means, 
are comparatively rare in cases where the index of dispersion is used, and it is probably for 
this reason that clustering effects are very often overlooked and the hypothesis of randomness, 
as defined by the Poisson law, accepted. 

8. There is one further application which might be mentioned. We might use the index of 
dispersion to test the null hypothesis that samples have come from a Neyman’s contagious 
distribution with specified m^. For example, suppose we consider some botanical data 
provided by Archibald (1948). A plant community was sampled with a quadrat, the number 
of plants of Plantago occurring in each quadrat being noted. It was found that the distribu¬ 
tion of the number of quadrats containing 0,1,2,... plants did not foUow Poisson’s law, and 



Variance/meat) 

Fig. 1 

it was suspected that there was clustering of observations owing to the fact that this species 
is root propagated. In fact, a large number of observations was collected and bleyman’s 
contagious distribution was found to fit the data very well. If now further samples are taken, 
either from a different locality or from the same locality in a different year, it is interesting 
to ask whether the variance/mean ratio has changed. For Plantago, twenty samples were 
taken at a different time of year and we have the following quantities; 

20 

iV = 20, « = 20-5, S = 1285-0, = 62-68; 

from previous large-scale work it was found that = 2. Hence for 19 degrees of freedom 

i"{;t®>2o/(l+«^2) = 20-89} = 0-34. 

We should conclude from these figures that the variance/mean ratio in the population could 
have remained unchanged, even though the population mean itself might have altered. 
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POWER OP THE MODIFIED t-TEST (u-TEST) BASED ON BASOK 

By B. lord, SUrhy ImUiute, DuMmry. Munclimkr 


1, iNTROinJCTION 

In a previous paper (Lord, 1947) wo have indicated how CHthnatos of Mtsuidaul deviation 
based on a total range, or on a mean range, may be used in tlu* ho-callct! wluni con¬ 

sidering the statistical significance of either the deviation of a sample mean from Home fixed 
or hypothetical population value, ortho difference between the meann of two KsunplcH. Irom 
tables at several probability levels, rapid estimates of the confidence limifs within whiidi the 
population mean may be assumed to be contained may hIko he obtained from a measured 
sample mean and the range or moan range among the individuals. It whh |>oinU*d out that 
these applications of the range, in idace of root-mcau-square estimatcK of afandaril deviation 
inthef-test, necessarily entailed some loss of precision. However, on the basis oi some of the 
results now given in full in the present paper, it was tmerted t hat the rednetion in aeouracy is 
negligible for all practical purposes, and is often cornimnsated by the. grt'ater ruise of computa¬ 
tion compared with the usual f-tcab. 

Whilst the original paper was in the press, a noto hy Daly (U)l(i) wius puhlished in which 
arange teat was suggested similar to one of the forma of the u-teNt. The (’ast* when the ('Htimate 
of standard deviation is made from the total range in a single set of n vahu's was disenwed, 
and approximate values of the ratio (deviation)/(range) on th<^ 10% probability le-vel were 
given for several low values of n. Bor two particular values, the jimver of the, range teat was 
found comparable with the power of the conventional f-test. Walsh (1947) alao conaidored 
forms of a significance test based on a single range (n < 10) and suggested that, for namplee of 
this size, discrimination is nearly as powerful as for the i-test. 

In various forms, the more general test based on the distribution of 

normal deviate 

u = ------- — - . 

independent range or mean-range estimate of standard error 
has been found useful in experimental laboratory work for considering significance of differ¬ 
ences between sample means and in estimating the accuracy of measunw of average character. 
In the industrial field, its simple nature permits easy routine application to the detection of 
changes in average quality of processed batches of material and t-o determining cpiiokly 
whether averages of samples, tested with a view to purch'ase or further use, deviate signifi¬ 
cantly from specified requirements. The present paper is therefore intended to justify more 
fi.rmly the value of the u-test. In particular, it shows that, over a wide field of useful applica¬ 
tion, the power to detect the existence of differonces is little less than that of the moBt powerful 
Hest. 

Use of the quantity ‘ standardized error ’ in preference to the power function often facilitates 
comparison of the two tests. It is shown, for example, that if the «-test detects a given real 
■fference 19 times out of 20 when using the 6% probability level, then with the tt-test this 
difference does not need to be more than 2^% greater for it to be detected with equal fre¬ 
quency. Moreover, in many cases the real difference need only be 1% greater for the tt-test 

t an for the t-tesh. Thus for most practical purposes the difference in disotimination is of 
neghgible importance. 
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When applying the M-test to medium and large samples, there is often a choice of size of 
possible subgroups into -which the observations may be divided to form mean range estimates 
of standard deviation. Tables are given to indicate which grouping combination in a fixed 
total number of observations leads to the greatest power of the w-test. It can be shown that, 
as would be expected, the grouping combination giving greatest power is the same as that 
yielding the most efficient estimate of standard deviation. When the number of observations 
permit, the size of the subgroups should generally be % = 8, and in any case between ?^ = 6 
and n = 10. Where the whole sample or samples may be divided in several ways into sub¬ 
groups of size 6-10, the choice of any one in preference to another does not, however, result in 
any appreciable loss in accuracy. 


2. The power op the f-TBST 


To obtain results -with which to compare the power of the M-test, it was first necessary to 
establish some new values for the power function of the t-test. If »is a variable normally 
distributed about a mean of zero, -with standard deviation cr, and if a is an independent 
estimate of cr based on v degrees of freedom having the distribution 


p{8) = 




gP-l 


( 1 ) 


then the ratio t = xja follows the well-known ‘Student’ distribution. The <-test may be used 
either in the symmetrical or asymmetrical form, according to whether we are seeking to 
detect changes in population mean in both directions or in one only. In the former case, 
using the 100a % significance level, we reject the null hypothesis that the population mean 
I = 0, if where 

a - i>(i < I (1+.»-«■«><«. m 

The power function of the test gives the chance of estabhshing significance when | + 0. Eor 
a given a and v, the power is a function ofp = ijcr and may be -written 

Power = P{p) = P'{p) + ^"(p), (3) 

where ^'(p) and ^"{p) are the probabilities that, when p > 0, f > and t < — respectively. 

Using the asymmetrical test, values of /^'(p) were first given by Neyman, Iwaszkie-wicz & 
Kolodziejczyk (1936) for a = 0-06 and a = 0-01. In the present paper, using the symmetrical 
test, we have taken |a = 0-026 and 0-006.* 


(a) Computation of /3'(p) cind ^'’{p)for cl ~ 0-06 
Putting cr = 1 for convenience in calculation, we may write 

where p(s) is given in (1). The expression for ^"{p) is obtained from (4) by -writing — p for p. 
Except in the case v — 1,2, where the integrals assume simple forms, computation was 
carried out by expressing (4) in terms of the Incomplete Gamma Function integral, I{u,p). 
Writing u ^ p = iv-1 

* Some results, presen-ted graphically, for the symmetrical test -with Ja = 0-026 have been given by 
Ferns, Grubbs & Weaver (1946). 

Biometrika 37 


5 



66 

we have from (4) 


( 5 ) 


Power of tnodijied t-test hcised on range 

/?"(/?) is obtained by writing (x+p) for [x —p), as before. 

Taking a = 0<05, and rising tables of the ordinates of the normal curve and of i he in complete 
r-functionin (5), a series of framework values of/y'(p) mid/flp) were obtained by rpiaikature 
methods for p = 1,2,.... 10 and r = 1, 2. 3,4, 5,9,14 and 20. With argument proportional to 
1/r and reciprocals of f'ip) fip) variate, a seven-point Lsgrangian formula was 
applied to points corresponding to r = 3,4, 6, 9, 14, 20 and co, and interpolation made of the 
components fi'{p) and for r'== 0, 7, 8. 10, 12, 16 and IH. The interval w<im then lialved 
using a nine-point Lagrangian formula to obtain the remaining intermediate vidiicH. The 
framework and interpolated values of y^'(p) and fi^ip) are given in Table 1 for integral values 
of p from 1 to 10 and v from 1 to 20. 

The sum f'{p) + f'\p) gives the power function of the symmetrical te.st (using a 5% 
significance level) with regard to the alternative.^ p > 0 and p < 0. On the other bund, fi'{p) 
gives the power function of the asymmetrical test (using a 2| % signiticance h‘vel) with regard 
to alternatives p > 0. 

In dealing with the t-test, Neyman & Tokarska (1936) have defined the ‘standardized 
error’, p,,, as the value of p for which 

l-/?{p)=a.* 

Thus, if we use the 5 % significance level, the chance will bo 0-96 of establishing Kignifiennce 
and 0‘05 of failing to do so, if the population mean has shifted from its position under the 
nuU hypothesis hy an amount g = pa,Q^cr. In what follows we shall use po-oj and in order 
to compare the efficiency of the <- and u-tests. 


(6) Computation of and pf^.Qi 

Por a = 0-06, approximate values of p^g^ corresponding to f(p) = 0‘05 were obtained for 
the framework values of u by interpolation in Table 1. To the number of figures used in this 
table it will be noticed that at p = the value f'ip) = 0, so that y9(p) = /f'(p). Accurate 
values of /?'(p), and hence of ^(p), were then determined for these framework values of r by 
numerical integration of (4) for a range of values of p (in steps of 0'006) close to the approxi¬ 
mate interpolated values of p,,Q5, The exact values were determined by subsofptent backward 
interpolation; the value of p(,,os for indefinitely large r was obtained from integral tables of 
the normal curve, the limiting form of the {-distribution. 

Por 0- = O'Ol, tables of ^'(p) and d''(p) had not been computed. The values p *= P(j,0j wtire 
determined for the framework values of v in a similar manner, first computing the values of 
A (p) [equal to /?(p) to the 6-figure accuracy used] by quadrature applied to equation (4) and 
then using backward interpolation. As before, the value of p^g^ for indefinitely large v was 
taken from integral tables of the normal curve. 

Lagrangian interpolation was then applied to these two sets of framework values to com¬ 
plete the range of values of pg.gg and pg.g^ given in Table 2. The values were differenced as 
a check and are probably correct to one unit in the last decimal place. 

* In terms of the ‘first’ and ‘second’ kinds of errors, this may be written 



Table 1. Power components of the t-test (a = 0-05) 
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Pow&f of Tnodified t-test based on tan^e 


Table 2. Standardized error of the t-test 
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3. The power op the u-tbst 

In tbe oi-test, lange estimates of the population Btandatd deviation are used in placH' of root- 
mean-aquaxe estimates; thus a; 

replaces t where, as before, under the hypothesis tested, x is distributed normally about a 
mean of zero. The quantity w = w(m,n) is the mean value of m ranges, obtained from m 
independent samples or subgroups, each oontaining n observations. The constant d^* is the 
expected value of the range in samples of Ti, selected at random from a normal population of 
unit standard deviation. The ratio w(m,n)/d„ is an estimate of the standard error of x 
determined from range. For a series of values of m and n, tables of the significance levels 
of u were given in an earlier paper (Lord, 1947) for a number of values of a. 

Although the i-test is the uniformly most powerful unbiased test of Student’s hypotheais, 
(Neyman & Pearson, 1936), for many purposes tbe ■u-test has the advantage of simpUoity and 
ease of computation. In section (a) below the power of the u-test is investigated for the case 
where the estimate of the standard error of ® is determined from a single range (usxraUy the 
total range in a sample of n values of which the variate x is the moan). The case of m > 2 is 
considered latex. As in the analysis of the t-test, the investigation is Umitied to the probability 
levels a = 0-06 and a = O’Ol in the symmetrical cose; from this, generalizatioufl may be 
drawn regarding the a = 0-02B and a = 0*005 probability levels of the asymmetrical ease. 

(a) Oofnpiitaiion of power and standardized error for the case wi = 1 
The analysis follows lines similar to those used in the investigation of the t-test. If p{w) is 
the probability distribution of the range w in a sample of n observations, then corresponding 
to equation (4) we have 

" Jo {w) (7) 

exI4>H?ordpublished in many places; see, for 
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The percentage points, of the distribution of u are analogous to those, of the distribu¬ 

tion of The expression for/?"(p) is similar to that of (7), obtained by writing {x -|- p) for {x—p). 

For n = 2, the values of/?'(p) and ^"(p) for u are identical with those for t with r 1 , since 
there is one-to-one correspondence between the range and root-mean-square estimates of o'. 
Again for indefijoitely large n, the values of the power are the same for t and u. For inter¬ 
mediate values of n, fresh computation is necessary. 

For 71^3, the integral p(w)dw was determined at intervals of 0-26 for x, using 

Jo 

manuscript tables of the integral! p(w)dw tabulated to 6 figures and loaned by H. 0 . 

Hartley. Using equation (7) with a value of a = 0-06, yS'(p) and y?"(p) computed by 
quadrature methods for values of p = 1,2,..., 10 and framework values of« == 3,4,5,6,10,14 
and 20 . A seven-point general Lagrangian formula, with argument proportional to Ijn and 
reciprocals of the variate, was applied to the points corresponding to w = 4, 6,6,10,14, 20 and 
00 to determine values of y9'(p) and /5"(p) for w = 7, 8 , 12, 16 and 18. The interval was then 
halved, using a nine-point Lagrangian, through even values of n from 4 to 20. The framework 
and interpolated values of the two components of fi(p) are given in Table 3. 

Approximate values of the standardized error were determined for framework values of n 
by interpolation in Table 3. As before, in the region of p = po. 05 , we have ^'{p) = yff(p) to the 
limit of accuracy of the tabulated figures. A range of values of ^{p) was obtained by applying 
quadrature to equation (7) for several values of p close to the interpolated approximate values 
of po,o 6 , p increasing in steps of 0'006. Exact values of Po.oB corresponding to fi{p) = 0-95 were 
determined using backward interpolation. Lagrangian interpolation was then applied to these 
exact fraipework values of Po,OB to determine the remaining corresponding values in the range 
of n from 2 to 20 . 

For a = O'Ol, tables of /?'(p) and /d'lp) were not determined over the field of p under con¬ 
sideration and consequently approximations to p^.^^ could not be obtained by immediate 
interpolation as in the case of p^.^ above. Nevertheless, computation proceeded on similar 
lines: quadrature was applied to equation (7) for the framework values of n to obtain in each 
case a series of values of J3'{p) = fi(p) corresponding to closely and equally spaced values of p. 
By backward interpolation exact framework values^ of Po-oi were found, and then Lagrangian 
interpolation used to complete the remaining values. The two sets of values of the standard¬ 
ized error, p„.o 5 and p(,,ox, are given in Table 4 and should not be in error by more than 1 unit 
in the last figilre. 


( 6 ) Computation of standardized error for the case m'^2 

In the generalized form of the u-test the estimate of the population standard' error of x is 
made not from a single range, w, but from the mean of m ranges, w(m, n) obtained from m 
independent samples or subgroups, each containing n observations. To simplify the algebraic 
expressions in what follows, this mean range w{m, n) is written as w where no confusion is 
involved. 

For a given probability level ct and a mean value of a; at a distance p > 0 from the origin (the 
standard error of x being taken as the unit), we may write the component /?'(p) of the power of 
the M-test as 

“ JJ dxdw, 


(8) 



Table 3- Power components of the u-test (m — l,a — 0*05) 
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Table 4. Standardized error of the u-test (m = 1 ) 


n 

Po 06 

Po-oi 

n 

e 

01 

PO'Ol 

2 

24-976 + 

163-99 

12 

4-062 

6-11 

3 

7-807 

21-66 

13 

4-028 

6-01 

4 

5-713 

11-98 

14 

3-999 

6-93 

6 

6-000 

9-21 

16 

3-976- 

6-86 

e 

4-662 

7-98 

16 

3-964 

6-80 
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4-461 

7-30 

17 

3-936 

5-76- 

8 

4-320 

6-88 

18 

3-920 

5-70 
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4-227 

6-69 

19 

3-906 

6-66 

10 

4-168 

6-39 

20 

3-893 

6-62 

11 

4-106- 

6-23 

00 

3-606- 

4-90 


where the limits of integration satisfy 0 ^ a: < co, 

0<wj<oo, 


X 

wld^ 




and where y — f (w) denotes the probability distribution oiw — w{m, n). Unlike equation (7), 
we shall integrate ( 8 ) first with respect to x and obtain 


^00 (*00 1 
p{w)dv)\_ 

JO JmiiJdn-p 

Similarly, it is easy to show that the second component of the power,, yS"(p), is a similar 
expression with + p written for — p in the limit of integration. 

In this section, values of the standardized error po-os ^-re determined over a range of values 
of m and n. As before, the second component, P”{p), of the power function is zero in the 
region of p = p^.^^ to the limits of accuracy used (five decimal places or more), and we therefore 
have p{p) = ^'(p). 

Tor a series of framework values of m and n, and using numerical values (uj„) of the 6 % 
points of the distribution of -a = u{m,n) tabulated previously (Lord, 1947), quadrature was 
apphed in each case to equation ( 8 ) to obtain a series of values /?(p) corresponding to a range 
of narrowly spaced values of p. By backward interpolation p^.^^ was then determined as the 
value of p corresponding to ^(p) = 0-96. This calculation was carried out to obtain framework 
values corresponding to w = 2, » = 2, 3, 4, 6, 6, 10, 16 and 20; to = 4, «, = 2, 3 and 4; and 
TO = 8 and n = 2, using values of the ordinate p(w) of the distribution of the mean range 
previously evaluated in the investigation of the tt-test cited above. The Hmiting value for 
Pq,o6 for indefinitely large to or indefinitely large n is, as in the preceding section, the limiting 
value of Pp .95 for indefinitely large v in the i-test. 

For m = 2, Lagrangian formulae were used to interpolate the intermediate values of the 
standardized error, taking arguments proportional to 1 jn and reciprocals of the corresponding 
standardized error for the variate. As a check, the values were inspected by determining the 
differences up to the second order, and then reduced by one place of decimals. These reduced 
values are given in Table 6 , together for convenience with reduced values for to = 1 from 
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Table 4. In the case of m = 2, framework values of had been calculated for m = 4 and 
m = 8 . Values of were determined for each chosen value of m by Lagrangian interpolation, 
using reciprocals of m for argument and reciprocals of the corresponding values of po,o 5 as the 
variate, the curve passing through the points corresponding to = 1, 2 , 4, 8 and oo. The 
interpolated values of p^.^^ obtained by this method, and the directly computed values for 
m = 4 and m = 8 are given in Table 6 for a series of values of to suitable for practical use. 
As a check upon the accuracy of this method of interpolation the computation was repeated, 
this time using a four-point Lagrangian passing through points corresponding to to = 1 , 2, 4 
and CO. Most of the interpolated four-point values of Pq.q 5 agree exactly with those obtained 
by five-point interpolation. Where differences occur, none amount to more than either 1 or 
rarely 2 units in the last tabulated figure. The five-point Lagrangian method of interpolation 
therefore appears adequate for furnishing the required degree of accuracy, an error not 
exceeding 1 unit in the last figure. 

For «. = 3 and w = 4 the values of the standardized error for different values of to are 
appreciably smaller and are nearer to their limiting values than in the case oin = 2. In view 
of the agreement between the four-point and five-point Lagrangian interpolated values of 
po.oB % = 2, a four-point Lagrangian through points corresponding to to = 1 , 2 , 4 and co is 
adequate for interpolation of Po .05 for these further two values of n. 

As a further check upon the validity of the above method, the values of Po-os for % = 4 were 
also interpolated for the chosen range of values of to, using a three-point Lagrangian curve 
through points corresponding to m « 1, 2 and 00 . This yielded interpolated values in exact 
agreement (to the number of figures given) with the four-point values in Table 6 . The 
accuracy of the three-point Lagrangian will certainly be no less for interpolating within the 
field of the less rapidly changing values of p^^^. It was applied in the case of values of n from 
5 to 20 to obtain interpolated values of the standardized error corresponding to the chosen 
range of values of to, and the results, after reduction to two decimal places, are given in 
Table 6 . 


4. EfFBOT OB GEOnPING IN THE ■W-TEST 

The case when the estimate of standard error of x is obtained from the mean of m ranges of n 
random values, instead of a single range, has been investigated for the a = 0-06 probability 
level by the determination of the standardized error po-os- Reference to Table 6 shows that for 
a sample containing, say, N = mn observations the standardized error is not cohstant but 
varies slightly for the different possible combinations of to and n. For example, taking 
W = 16 we have the following values of poos’ to == 8 and = 2 ; 3'96 for to = « = 4; 

3'92 for TO = 2 and w = 8 ; and 3-96 for to = 1 and n = 16. 

The variation in the values of po.o 6 is more pronounced for small samples than for large 
samples. For N = 10 , p^.^^ falls from the value 4-68, corresponding to to p= 6 and u = 2 , to 
4-16 when the estimate of standard deviation is determined from the total range of values, 
i.e. when to = 1 and n = N = 10. For larger samples Po.o6 faUs from a maximum at n = 2 to 
a minimum for a particular combination of to and n, and then increases again as n approaches 
the sample size N. When the size of the sample is such that it may be divided in several ways 
mto random subgroups of different size n, the greatest power of discrimination corresponding 
to the minimum standardi z ed error occurs when « = 8. As would be expected, it can easily 
be shown that this size of subgroup also gives the most efficient mean-range estimate of 
standard deviation of indefinitely large samples. More particularly, comparison of the values 
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of po 05 inTable Swith the corresponding figures for the standard error of mean-range estimates 
of standard deviation of samples of finite size^ == nvn, indicates that the grouping combina¬ 
tion giving the greatest power of discrimination in the tt-test is the same as that yielding the 
most accurate estimates of standard deviation. 

The loss of power of the 'W-test, attendant upon the use of a number of subgroups of very 
small size, is caused primarily because we ignore the variation between the subgroups in 
forming an estimate of the variate standard error. A similar loss of power also arises in the 
application of the usual i-test, if the estimate of standard deviation is determined from the 
variation in subgroups of a sample of total size N. Here the loss is represented by a reduction 
in the degrees of freedom of the estimate of variance, from A' — 1 to ^—m. 

If he a prime number, it is still preferable to divide the sample into subgroups for esti¬ 
mating the standard deviation by mean range. The theory indicates that however large N, 
the w-test is nearly as powerful as the ^-teat. Nevertheless, in practice it is advisable not to 
overlook the possibility that the variate does not exactly follow the normal law, particularly 
at the tails of the distribution where the extreme individuals from large samples wxU fall. 
Again, N may not be prime hut contain only one Iqw factor or only large factors. If all the 
observations were used, the estimate of standard deviation would be determined from the 
mean range in either a large number of very small subgroups (of size, say, » = 2 or 3) or a 
small number of very large subgroups. In both instances, it is generally ad-visable to ignore 
a few observations and divide the major portion of the sample into random subgroups of 
equal size. Two illustrative examples hearing on these points are given below. 

Suppose we wish to determine whether the mean {x) of a sample of 19 values is consistent 
with the parent population having some h37pDthetioal mean value To test this null 
hypothesis we could determine the ratio 

u = I I ^19 V(1Q) 

%8 


With u based on the total range, m = I and n = 19, Table 5 gives p().o 5 = 3-91. A slightly 
greater degree of accuracy would result from the use of an estimate of standard deviation 
based on m = 2 ranges of» = 9 random values, for which pg.f,s = 3-89. It is of course essential 
that the choice of the groupings , of 9 should be random. If the order of occurrence of the 


observations is known to be independent of their magnitude, as frequently happens in 
practice, we would probably accept the first nine numbers to form one group, the 10th to the 
18th as the second group, and ignore the 19th in determining the range estimate of standard 
deviation. The ignored value is, of course, included with the others in computing the sample 
mean x, and the corresponding u would be [ *- g j d!, ^{I9)jw{2,9 ). 

As a further illustration of the effect of grouping, we shall consider the case when the mean 


(Xi) of a sample of say 34 values is to he compared With the mean (x^) of a second sample 
containing 61 values. W e could estimate the standard error of the difference between x^ and X 2 
from the mean w(6,17) of 5 ranges, each of 17 values, i.e. using 2 random subgroups of 17 
values from the first sp,mple and 3 random subgroups of 17 from the second. The value of u 

‘\/(^+'A:) ’ 


and its statistical significance could be gauged by comparing its value with tabulated per¬ 
centage points of u(6,17). From Table 6, the corresponding standardized error of the w-test 
for w = 6 and » = 17 is 3-67, Alternatively, we might estimate the standard error of the 
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difference from the mean of m = 8 ranges of n = 10 values, 3 ranges from the first sample 
(with 4 values discarded at random) and 5 ranges from the second (1 value discarded at 
random). The appropriate equation for u would then he 

I % ~ ^2 I ‘^10 

w{9,, 10 ) 

By varjdng the size of subgroups and discarding a few odd values, several other combinations 
are feasible. The table below contains some combinations which might possibly be chosen in 
practice with these data, and gives the standardized error when the range estimate of 
standard deviation is based on ranges of n values from the first sample and from the 
second. (Values of the standardized error are given to 3 decimal places, calculated from the 
original values of Table 6 before reduction to 2 decimals. These interpolated values may be in 
error by 1, less Uhely by 2, units in the last place.) It will be seen that the efficiency of the 
test, as measured by Po-o 5 > scarcely differs throughout the range of n considered. 


n 



POK 

Observations 

discarded 

17 

2 

3 

3-666 

0 

10 

3 

6 

3-664 

6 

9 

3 

6 

3-670 

13 

8 

4 

6 

3-664 

5 

7 

4 

7 

3-666 

8 

6 

6 

8 

3-667 

7 

6 

6 

10 

3-668 

6 


Table 6 may be used in cases such as those above, to determine quickly the grouping 
combination which wifi, give the greatest accuracy in application of the w-test. Generally, it 
would appear from Table 6 that samples of size N's^lZ should be divided into subgroups of 
equal size and the estimate of standard error made from the mean range within the subgroups. 
Where possible, the ,size of the subgroups should be w = 8, in any case not greater than 
n = 10 nor less than w = 6. The division of a whole sample in this way may entail discarding 
a few ‘ surplus ’ observations in determining a mean range, but these are not excluded from 
the sample mean. When, as above, the sample may be divided in several ways in subgroups of 
size from 6 to 10, the choice of any one in preference to another wiU certainly not lead to any 
appreciable loss of accuracy. 

6 . Power comparison op t- and w-tests 

A comparison of Tables 1 and 3 shows the relative efficiency of the symmetrical t- and w-tests 
in establishing significance at the 6 % probability level, in the case where the range estimate 
of a is derived from a single group of n observations. It is clear that while for a given value of 
p ~ ^jcr the ^-test is always the niore powerful, the difference is barely appreciable for many 
practical purposes. 

The power of discrimination of the two tests may also be compared in terms of the standard¬ 
ized errors Pq,q^ and po.(,i given in Tables 3 and 4. Table ff shows the ratio of the standardized 
error of the tt-test to that of the f-test. The maximum value of this ratio for p^.^^ is seen to be 
1'024. This, for example, means that with a sample of n = 16, whereas the odds are 19 to 1 on 
establishing significance at the 6 % level with the t-test if there is a shift in population mean 
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of ± 3'862cr/V(l6) = ± 0-9655cr from the value specified by the nuU hypothesis, the shift must 
be nearly 2^ % greater for it to be detected with the same odds if o* is estimated from the range. 
If the 1 % level is used, and odds of 99 to 1 on establishing significance are taken, a 4'| % 
greater shift in mean is needed with the tt-test than with the f-test. 

Standardized errors are particularly applicable to study of the w-test when the estimate of 
standard error of the variate is based upon the mean of ranges within random subgroups of 
equal size. For example, suppose we have a single sample of « == 20 and wish to establish 
whether the population mean has a specified value. With the <-test for = 19 degrees of 
freedom, Table 2 gives po.QB = 3 > 804 . With the u-test and using the total range in the 20 values. 
Table 4 gives po^os - 3-893. Correspondingly, the ratio 3-893/3-804 = 1-023 as noted in 
Table 6. If in place of the total range the mean of two ranges of 10 values be used in the 
-M-test, Table 6 gives 3-86 for po. 05 . This latter value is not quite 2 % greater than Po .05 for the 
i-test and is slightly less than the value arising from the total range. 


Table 6. Jtatios of standardized errors ofu- and t-iesis 


n 

Ratio of standardized errors 

n 

Ratio of standardized errors 

0-06 

0-01 

0-06 

0-01 

2 

1-000 

1-000 

12 

1-023 

1-046- 

3 

1-008 - 

1-008 

13 

1-023 

1-046 + 

4 

1-010 

1-018 

14 

1-024 

1-046 + 

6 

1-016- 

1-028 

16 

1-024 

1-046- 

6 

1-017 

1-033 

10 

1-024 

1-046- 

7 

1-019 

1-036 

17 

1-024 

1-044 

8 

1-021 

1-039 

18 

1-024 

1-043 

9 

1-022 

1-041 

19 

1-024 

1-043 

10 

1-022 

1-043 

20 

1-023 

1-042 

11 

1-023 

1-044 

00 

1-000 

1-000 


As a further illustration of this method of comparing the tests, we may consider the testing 
of the statistical significance of the difference between the observed mean values of two 
samples, each of size, say, n = 30. From Table 2, use of the t-test on the 6 % probability level 
is seen to give a standardized error of about 3-66 (r = 68 degrees of freedom). With the w-test, 
if each sample he divided into, say, S'suhgroups of 10 values and the mean of the 6 ranges be 
used to estimate the standard error of the observed difference, reference to Table 6 gives 
Po -05 = This value differs from the i'test value of 3-66 by less than 1 %. 

The foregoing investigations appear to justify previous claims made for the use of range in 
place of root-mean-square estimates of standard deviation in an analogue of the usual <-test. 
F6r most practical purposes the loss in power accompanying the use of the range is negligible 
and, indeed, is generally compensated by the appreciably simpler and quicker method of its 
application in a wide range of problems frequently arising in both routine testing and investi¬ 
gational work. 
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THE USE OE MEAN RANGE AS AN ESTIMATOR OF VARIANCE 

IN STATISTICAL TESTS 

By P. B. PATNAIK 

1, iNTRODtrOTION 

The distribution of the range in random Bamples from a normal population has been studied 
numerically by Tippett (1925) and Pearson (1926, 1932). McKay & Pearson (1933) have 
obtained the general expression for tho distribution. Hartley (1942) determined a simpler 
expression for the probability integral and with Pearson (1942) tabulated this for samples 
of size re = 2 to 20. 

On’y the first two moments of the range* have so far been fully calculated and are available 
numerically (Table A, Pearson, 1932), although values of /?i, are Imown exactly for re up 
to 6 and, approximately, after 6 (Pearson, 1926, p. 192). It is possible, however, to compute 
tables of the exact moments from those of the probability integral by quadrature.t 
The use of the range in place of the root-mean-square estimate of tho population standard 
deviation has become important in several fields, particularly in quality control. Although 
the range furnishes a less efficient estimate, its simplicity and ease of application in routine 
work, such as production-line inspection, makes it an important statistic in practice. 

It is known that the distribution of the range in normal samples depends on the sample 
size re, is independent of the population mean, but dependent on its standard deviation, cr. 
Moreover, for large re (say re > 20), even small departures from normality in the tails of the 
parental distribution have a considerable effect on the distribution of range. Furthermore, 
the relative efficiency of the range as an estimator of cr decreases as re increases. Hence, in 
practice, when re exceeds say 12, it is preferable to divide the sample into a number of groups 
and take a weighted mean of the several group ranges. The question of the subdivision which 
will give the smallest variance of the estimate has been considered by Pearson (1932) and by 
Grubbs & Weaver (1947). It is found that groups of seven or eight'are the best. It will 
generally be advantageCus to have equal groups of about this size and use the average of the 
group ranges, viz. the mean range. 

The exact distribution of mean range cannot be obtained in a simple form, except in the 
trivial case of two samples of two observations in each. We shall, however, obtain an approxi¬ 
mation to the distribution and, from this, derive the distribution of the ratio of a normal 
variate to mean range and compare it with the results of Lord (1947), who has studied the 
position numerically. We will also find an approximate distribution of the ratio of an in¬ 
dividual range to mean range. These distributions will be used to obtain certain statistical 
tests. 

2. Approximation to the distribution of mean range 

Denote by x^, iCj, a random sample of re observations, arranged in ascending order of 

magnitude, drawn from a normal population having mean /i and standard deviation cr. Then 
the range in this sample is denoted by 

* ‘Range’ will denote, throughout, the distance between the highest and the lowest observation in 
a sample randomly selected from ^ ixortnal population, 
t [Calculations, for sample sizes up to 20, have now been completed. Ed.] 
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If there are m such independent samples, with n observations in each, the mean of the m 
ranges wiU then be denoted by 

Suppose the mean and variance of are written as crd^ and var (w^). Then the mean and 
variance of the distribution of w^ Jcr are given by 

^{Wm,nl<r) = d^ = M, say, 

_ 1 (1) 
var {w^Jcr) = —^ ^ar (wj = V, say. 

Hence we see that gives an unbiased estimate of o-, 

Pearson (1926, p. 191) has given a diagram showing the /?2 points of the distribution 
of w^. If the sample contains less than about twelve observations, these points lie in the 
Type I area and not far from the Type III line; the /?2 points for the mean range, 
will lie in the same area, but closer to the normal point, = 0, = 3. Since the 

points for the distribution of y fall in the same region and converge, as the degrees of freedom 
increase, on the normal point, it seems likely that a y-distribution wiU give a reasonably 
accurate representation of the distribution of ,j. 

Identifying the first two moments, M and V, ofw^^Ja- with those of cy/y'v, where y has 
V degrees of freedom, we obtain the following relations: 





Expanding the F-functions by Stirling’s formula, we find 



^ 4j, ^ 32^2 128:^2 + • ] 

1. 

(2) 

4v’''32r2'^128v2'*'' 

■■)T 

( 3 ) 

from which follows the equation 



Z-_l//l_l-p 1+ 1 4-..V 
l\ 2v 8v^ lQv^ } 

y 111 

il!f2~2i.>'’‘8r2 16j/» 

-h 

(4) 


Betaining the first two terms on the right-hand side of (4) and solving the resulting quadratic, 

llv = -2 + 2^{l + 2k). 

A further approximation, using the term in l/(r®) gives 

llv = -2 + 2^{l + 2j), (6) 

where j = jfc-pl/(16v3) = F/Af^-I-l/(16v®), the first approximation to v being used in the 
second term. The corresponding expression for c, to the same order of approximation as 
V in (5), is 


in which M can be replaced by 


= lf 




4p ’ 32j^* 128^3 


}■ 


( 6 ) 
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Thus we can represent the distribution of W„^J{ccr) by that of xlsja follows the 
distribution of x/^/r, s being the sample root-mean-square estimate of cr based on v degrees 
of freedom, it follows that is distributed approximately as cs. 

From the mean and standard deviation of range given in Pearson’s Table A (I9:i2), the 
values of M and V in (1) are known, and using these in (6), v is obtained and then r from (6), 
We give here (Table 1) a short table of v and c for » = 3 to 10, in ~ I to 5. 

Table 1. Values of cZ„, r and cfor the x approximation to 


Size 

of 

sample 

n 

dn 

No. of samples 


■ 

m 

= 2 

tn- 

= 3 

m 

= 4 

m 

= 6 

V 

c 

a 

c 

V 

c 

g 

g 

g 

0 

3 

1'6926 

1-934 

1-9164 


1-8049 

6-674 

1-7684 

7-499 

1-7498 

9-312 

1-7386 

4 

2-0688 

2-961 

2-2374 

6-706 

2-1606 

8-460 

2-1204 

11-191 

2-1062 

13-931 



2-3269 

3-828 

2-4812 

7-474 

2-4048 

11-107 

2-3788 

14-732 

2-3667 

18-305 

2-3578 

6 

2-6344 

4-692 

2-6721 

9-169 

2-6001 

13-641 


18-109 

2-6696 

22-570 


7 

2-7044 

6-499 

2-8296 

10-779 

2-7677 

16-062 

2-7468 

21-324 

2-7362 

26-696 


8 

2-8472 

6-269 

2-9630 

12-297 

2-9066 

18-328 


24-368 

2-8768 

30-386 

2-8707 

9 

2-9700 

6-989 

3-0778 

13-763 

3-0246 

20-611 


27-270 

2-0074 

34-025 

2-9920 

10 

3-0776 

7-689 

3-1789 

16-161 

3-1287 

22-609 

3-1117 

30-060 

3-1032 

37-623 

, 3-0981 


N.B. w„,„/<r ia distributed approximately as cy/Vr, where c is a scale factor and v a fractional degree of 
freedom. 


Unfortunately, there is at present no direct means of judging the accuracy of the above 
approximation. When the exact moments of above the second are computed, it will be 
possible to derive the higher moments of and so compare them with the moments of 
our approximate s-distribntion. The probability integral and percentage points of the 
distribution can be obtained approximately from those of the x and hence from those 
of the x^-distribution with degrees of freedom given by the v of equation (5), 

Turning to Table 1, we note the way in which c tends to from above as n increases; 
further, we see that the equivalent, ‘fractional’ degrees of freedom, v, of the approximation 
are always rather less than the figure appropriate were we to estimate cr from the 

within-group sums of squares. 


3. Disteibution or xjw 

Let a; be a variate distributed normally with mean zero and standard deviation cr, and let 
s be an independent root-mean-square estimate of cr based on v degrees of freedom. In § 2 
it was seen that the mean range could be used for estimating cr. Therefore in parallel with 
the ratio i, we may take the ratio 

where w stands for and is the expectation of the range in samples ofn. 

Lord (1947, 1960) has considered this distribution and developed the ‘w-test’, giving 
several of its applications. A wide range of tables of percentage points have been computed 

* In the rest of this section w will be used for 
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by him by methods of quadrature and interpolation. Daly (1946) also deals with this test, 
but he takes a single range instead of the mean range. 

We wiU now employ the approximate distribution oiw obtained in § 2 to derive an approxi¬ 
mation to the distribution of u. Since w is represented by cs, we see that the distribution of 
M can be approximated by that of ^ a 

( 8 ) 


u = 


cs 


where t is based on v degrees of freedom, c and v being given by equations (5) and (6). In other 
words, u[l + l/(4v) -b l/(32u*) — 6/(128v®)} is distributed approximately as ‘Student’s ’t with 
degrees of freedom v given by equation (5). It is therefore possible to find approximate 
percentage points for w by interpolating for a fractional v in any table of the percentage 
points of t. Using this method, we have calculated the percentage points of the distribution 
for significance levels’’' a = 0-10, 0-05, 0'02 and 0*01 for several values of w and m. They are 
shown in Table 2, and Lord’s values are given alongside for comparison. The good agreement, 
even for low values of a and for m = 1, i.e. for a single range, suggests that the distribution 
of u is closely approximated by that of d^tjc. We may also infer that the ;\;-approximation 
to the distribution of w is fairly good. 


Table 2. Values of the percentage points of the distribution of u = d^xlw,„^^ 


Size 

of 

sample 

n 

No. 

of 

samples 

m 

« = 0-10 

a = 0-06 

« = 0-02 

0 

0 

II 

Approx.* 

Lordt 

Approx.* 

Lordf 

Approx.* 

Lordf 

Approx.* 

Lordf 

6 

1 

2-02 

2-02 

2-64 

2-63 

3-68 

3-66 

4-39 

4-38 


3 

1^^6 

1-76 

2-15 

2-16 

2-66 

2-66 

3-03 

3'02 


6 

1-71 

1-71 

2-07 

2-07 

2-61 

2-61 

2-83 

2-83 


10 

1-68 

1-68 

2-01 

2-01 

2-42 

2-42 

2-70 

2-70 

8 

1 

1-86 

1-85 

2-33 

2-32 

2-98 

2-96 

3-50 

3-46 


3 

1-71 

1-71 

2-07 

2-07 

2-61 

2-61 

2'83 

2-83 


6 

1-68 

1-68 

2-03 

2-02 

2-44 

2'43 

2-73 

2-72 


10 

1'66 

1'66 

1-99 

1-99 

2-38 

2-38 

2-66 

2-65 

10 

1 

1-81 

1-81 

2-26 

2-24 

2-83 

2-81 

3'29 

3-24 


3 

1'70 

1-70 

2-06 

2-06 

2-48 

2-47 

2-79 

2-78 


6 

1-68 

1-68 

2-01 

2-01 

2'41 

2'4l 

2-70 

2'69 


10 

1-66 

1-06 

1-99 

1-98 

2-38 

2-37 

2-64 

2-03 


* Computed from the {-approximation suggested above, 
t Computed by Lord, using numerical quadrature. 

To test for the significance of (a) the difference between the mean of a sample, x, and a 
pre-assigned value of a population mean, fi, (6) the difference between two sample means 
^ 2 > w® form test criteria using the mean range of the observations in the sample or 
samples concerned. It is known that the sample mean is statistically independent of the 
range in the sample. The mean x is, therefore, also independent of the mean range w of the 
subgroups of the samples. 

* We have considered here the double-tailed test, rejecting the null hypothesis if I {I > where 

■P{U! ><*«} = «• 
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Thus we can represent the distribution otW,„^J{c<r) by that of .Siiicfi ,v/o- f(»Ilnws the 
distribution of xlfv, s being the sample root-mean-square estimate, of a based on v degrees 
of freedom, it follows that is distributed approximately as cs. 

From the mean and standard deviation of range given in Pearson’s 'ruble A (19:i2), the 
values of if and Fin (1) are known, and using these in ((t), vie obtained and then r from ((5). 
We give here (Table 1) a short table of d,^, u and o for w = 3 to 10, 1 to 5. 

Table 1. Values of i> and cfor the x appnmmatio/i to 


Size 

of 

sample 

n 

d„ 

No. of samples 

m 

= 1 

wt 

■ 

m 

= 3 

m 


m 

= 6 

V 

c 

■ 

■ 

D 

c 

v 

c 

V 

c 

3 

1-6928 


1-9164 

3-860 

1-8049 

6-074 

1-7684 

7-499 

1-7498 

0-312 

1-7386 

i 


2-961 

2-2374 

6-706 

2-1606 

8-460 

2-1204 

1M91 

2-1062 

13-931 

MUlIiM 

5 

2-3259 

3-828 

2-4812 

7-474 

2-4048 

11-107 

2-3788 

14-732 

2-3(!67 

18-365 

2-3578 

6 



2-6721 

9-169 

2-6001 

13-641 

2-6812 

18-100 

2 -r)(!l)6 

22-676 

2-6626 


2-7044 

6-499 

2-8296 

10-779 

2-7677 

16-062 

2-7468 

21-324 

2-7362 

20 -6y(i 



2-8472 



12-297 

2-9066 

18-328 

2-8860 

24-368 

2-8708 

30-386 

2-8707 





13-763 

3-0246 

20-611 

3-0064 

27-270 

2-m)74 

34-026 

2-9920 

10 


7-689 


16-161 

3-1287 

22-609 

3-1117 

30-006 

3-1032 

37-523 



N.B. tUn, Jcr IS distributed approximately ae cx/V*** where c is a scale factor and r a fractional degree of 
freedom. 


Unfortunately, there is at present no direct means of judging the accuracy of the above 
approximation. When the exact moments of above the second are computed, it will be 
possible to derive the higher moments of and so compare them with the moments of 
our approximate s-distribution. The probability integral and percentage points of the 
distribution of „ can be obtained approximately from those of the y and hence from those 
of the x^-distribution with degrees of freedom given by the v of equation (15). 

Turning to Table 1, we note the way in which c tends to from above as n increases; 
further, we see that the equivalent, 'fractional' degrees of freedom, v, of the approximation 
are always rather less than w(ji— 1), the figure appropriate wore wo to estimate o' from the 
within-group sums of squares. 


3. Distribution of xjw 

Let a: be a variate distributed normally with mean zero and standard deviation a, and let 
s be an independent root-mean-square estimate of cr based on p degrees of freedom. In § 2 
it was seen that the mean range could he used for estimating cr. Therefore in parallel with 
the ratio t, we may take the ratio 

( 7 ) 


u = 




where w stands for and i^or is the expectation of the range in samples of n. 

Lord (1947, 1960) has considered this distribution and developed the ‘w-test’, giving 
several of its applications. A wide range of tables of percentage points have been computed 

* In the rest of this section w will be used for 55 
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by Mm by methods of quadrature and interpolation. Daly (1946) also deals with this test, 
but he takes a single range instead of the mean range. 

We will now employ the approximate distribution of w obtained in § 2 to derive an approxi¬ 
mation to the distribution of u. Since «5 is represented by cs, we see that the distribution of 
u can be approximated by that of 

( 8 ) 


cs c 


where t is based on v degrees of freedom, c and v being given by equations (S) and (6). In other 
words, u{\ + l/(4v) + 1/(321.'^) — 6/(128v^)} is distributed approximately as ‘Student’s ’t with 
degrees of freedom v given by equation (6). It is therefore possible to find approximate 
percentage points for u by interpolating for a ifractional v in any table of the percentage 
points of f. Using tMs method, we have calculated the percentage points of the distribution 
for significance levels* a = 0-10, 0-05, 0'02 and 0-01 for several values of n and m. They are 
shown in Table 2, and Lord’s values are given alongside for comparison. The good agreement, 
even for low values of a and for m = 1, i.e. for a single range, suggests that the distribution 
of u is closely approximated by that of We may also infer that the ^-approximation 
to the distribution of w is fairly good. 


Table 2, Values of the percentage points of the distribution of u = 


Size 

of 

Bomple 

n 

No. 

of 

BampleB 

m 

a = 0-10 

a, = 0-06 

a = 0*02 

a = 0-01 

Approx.* 

Lordf 

Approx.* 

Lordf 

Approx.* 

Lordf 

Approx.* 

Lordf 

5 

1 

£■02 

2-02 

2<64 

2-63 

3-68 

3-68 

4-39 

4-38 


3 

1-76 

1'76 

2-16 

2-16 

2-66 

2-66 




6 

1-71 

1-71 


2-07 

2'51 

2-61 

2-83 

2-83 


10 

1-68 

b68 

2-01 

2-01 

2-4:2 

2-42 

2-70 

2-70 

8 

1 

1-86 

1-86 

2'33 

2-32 

2-98 

2-96 

3-60 

3-46 


3 

1-71 

1-71 

2-07 

2-07 

2'61 

2-51 

2-83 

2-83 


6 

1-68 

1-68 

2-03 

2-02 

2A4 

2-43 

2-73 

2-72 


10 

1*06 

1-68 

1'99 

1-99 

2-38 

2-38 

2-65 

2-05 

10 

1 

1-81 

1'81 

2-26 


2-83 

2-81 

3-29 

3-24 


3 



206 


2-48 

2-47 

2-79 

2-78 


6 

1-68 

b08 

2-01 


2-41 

2-41 

2-70 

2-69 


10 

1-66 

1-66 

1-99 


2-38 

2-37 

2-64 

2-63 


* Computed from the {-approximation suggested above, 
t Computed by Lord, using numerical quadrature. 

To test for the significance of {a) the difference between the mean of a sample, x, and a 
pre-assigned value of a population mean, p, (6) the difference between two sample means 
*11 *ai we can form test criteria using the mean range of the observations in the sample or 
samples concerned. It is known that the sample mean is statistically independent of the 
range in the sample. The mean x is, therefore, also iudependent of the mean range w of the 
subgroups of the samples. 

* W© have considered here the double-tailed test, rejecting the null hypothesis if ({| > {j;,, where 

I ^ *»«} = «• 
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In case (a), if the sample of N 
each,* then we form the ratio 


can be divided randomly into m subsamplcs of n observations 
cu c>JN[x-fi) 

U = — =--, \9) 

'^m.n 


which will be distributed as t in virtue of (8), with degrees of freedom. In case (6), if the two 
samples of sizes N^, can be randomly divided into Wj suhaamples of size «,* then the 
mean of the h = + ranges is taken and the statistic 




( 10 ) 


follows the distribution of t with v degrees of freedom. Thus in both cases we refer v to the 
i-probabihty scale, v and c are given by equations (6) and (6), and in certain ca.ses their values 
may be taken from Table 1. We shall illustrate the procedure by an example. 

Example 1. Consider the data of Example 6 given by Lord (1947, p. 60). The mean strength 
(in lb.) of cotton yarn in two samples, A (with Wj = 30) and B (with Alg = 20), and the ranges 
of the five subsamples, of ten observations each, are; 


Sample A Sample B 

Mean 28-90 27-40 

Range 3-0, 6-0, 6-0 4-0, 3-6 


Hence, mean range, =4*1, difference of means —*a = 1'5. 

From Table 1, c = 3*098, v = 37*62. The computed value of v in (10) is 3*926. This falls 
beyond the 0*1 % point for t, which for v = 37*62 is at about 3*6, and therefore the difference 
in strength of the two batches of yarn is certainly significant. 

The value of ‘Student’s ’t for the data of this example was found to be 3*7, which again 
exceeds the 0*1 % point of t for 48 degrees of freedom. 


4. Distbibtjtion ot’ Wjw 

Suppose ffjv is the range in a sample of N observations from a normal population with mean 
fi and standard deviation tr. Let there be m further independent samples of n drawn from the 
same population, and let the mean of their ranges be Using the s-approximation to 
the distribution of w obtained in § 2, it follows that the ratio 


9 ' = 




N 


itt™ 


( 11 ) 


will be distributed approximately as the ratio of (a) a range in a sample of N observations, 
to (6) an independent root-mean-sqnare estimate of cr based on v degrees of freedom, where 
V and c are given by equations (6) and (6). This ratio is the so-called ‘Stndentized’ range, 
q — Wjfjs, the probability integral and percentage points of which have been tabled by 
Pearson & Hartley (1942).f 

The accuracy of the above approximation to the range ratio IF jw could only be judged 
when the exact percentage points are computed by methods similar to those used for 

* In the preceding paper, Lord (1960) has shown that it may be worth while omitting a few obser¬ 
vations in the estimation of tr, in order to ensure the breaking up of the remainder into appropriate 
equal groups. 

f Note that the n of their tables corresponds to our N. 
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However, Hartley’s lemma (1948) tells us that the maximum error in the probability integral 
of Wjw will be less than the maximum error in the probability integral of w, which may be 
fairly small judging from the agreement in the percentage points oid^xlw. 

It may be noted that it would have been possible to employ the s-approximation for 
as well as for and so regard the square of the ratio Wjw (when multiplied by the appro¬ 
priate constant) as equivalent to a variance ratio, F. But as is a single range, not a mean 
range, it seems probable that the ‘Studentized’ range approximation will be the more 
accurate. 


5 . APPUCATION- op the DISTRIBHTION op Wjw TO THE ANALYSIS OP VARIANCE 


Using the range-ratio, Wjw, we can formulate a test of significance, analogous to the i^’-test, 
applicable to analysis of variance. We shall consider a One-way classification where there are 
m groups with n observations in each. 

Whether the systematic set-up* or the random set-up is relevant, if the nuU hypothesis 
is true, the observed group means are distributed normally with variance = trg/n, where trg 
is the residual variance within the groups. 

If Wjn is the range of the group means and the mean of the m group ranges, it can be 

shown that these two quantities are statistically independent. Hence, using our approxi¬ 
mation for the ratio g = is approximately distributed as WJs, where s is 

independent of Now W,n is ‘Studentized’ when it is divided by sj^jn, the estimate of 
crj^jn. Hence c is a ‘Studentized’ range of a sample of size m and with degrees 

of freedom v. 

Thus the ‘range-test’ for the hypothesis of no variability between groups consists in 


evaluating 


W • 

q=z^c^Jn, 


( 12 ) 


and testing whether or not it exceeds the 100a % point of the ‘Studentized’ range for m 
and V. The procedure may beat be illustrated by an example. 

Example 2. The following table gives the yield of grain in bushels per acre, corresponding 
to seven varieties (Weatherburn, 1947, p. 213): 



* The distinction between the systematic and random set-ups has been described by a number of 
authors; see, for example, Daniels (1939), Johnson (1948) and Patnaik (1949, p. 226). 
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We find % = 3*4, Mj' 7,6 = 

Further if = 4 - 2-32593 and, from Pearson’s Table A (1932, p. 416), the variance of 
Wj/cr is (0-8641)2. Hence, from equation (1), F = (0-8641)2/7 = 0-10667. Introducing these 
values into equations (5) and ( 6 ), we find 

V = 26-61, c = 2-349. 

Finally, from (l2) we have q = 3-049. This value is considerably below the upper 5 % limit 
for g* given in Pearson & Hartley’s tables, form = 7, n = 26-61, viz. 4-63. The data, therefore, 
do not suggest the existence of significant differences in the variety yields. 

By the ordinary analysis of variance, the ratio of the mean square between varieties to 
that within varieties is found to be 1-1, while the Fg.Q^ for = 6 , = 28 is 2-45. Thus the 

range test leads to the same conclusion as the F-test. 


6. The poweb oe the u, oe banqe, test 

The ratio m, of equation (7), may clearly be used as an alternative to t in tests of significance, 
Using our method of approximation, we shall now examine to what extent u is less efficient 
than t in detecting true differences in mean values. This may bo done by deriving the power 
function of the w-test and comparing it with that of the i-test. In his second paper. Lord 
(1950) has made an exact comparison, using methods of quadrature; in wliat follows wo shall 
apply a more approximate method, based on an adaptation of the non-central i-distribution, 
In (7), X was assumed to have a mean, /t = 0. If in fact ^(x) = /< + 0 , then it can be written 

z+ftia- 

^ wKd^cr) wl{d^cry 


where i[&) = 0 and var ( 2 ) = 1. The ratio will follow what may be termed a non-central 

M-distrihution. If now we use the ca approximation to w derived in § 2, it is seen that u may 

he written as j , 1 

d^ z+fijcr 

c s/o' ’ 


or, expressed in another way, 


_ CM _ z + pijar 
w~ d^~ a\(r 


(13) 


It follows from (13) that [a) if /< = 0, cxjw is distributed as t with v degrees of freedom; 
(6) if p,+0, it is distributed as non-central t with v degrees of freedom and displacement /tjcr. 
c and V -^1 be given as before by equations (6) and (6). Thus the power function of Lord’s 
t6-teBt may be obtained, to the degree of approximation involved, from the power function 
of ‘ Student’s ’ i-test, using the appropriate fractional degrees of freedom for v. 

Tables of the power of the t-test have been given by Neyman (1936). They are for the 
asymmetrical comparison, i.e. the case where we reject the null hypothesis if t ^ where 
~ Suppose that the estimate of variance is to be based on m groups of n obser¬ 
vations ; then using ‘ Student’s ’ test, we shall have an estimate of cr^ baaed on to (71 — 1) degrees 
of freedom, while the equivalent degrees of freedom for Lord’s test will be the fractional v 
derived from equation (6) or, where possible, from our Table 1. Some comparisons of the 
two tests are made in Table 3 below, for displacements /tjcr = 1,2 and 3. 

As we should expect, since v < m(n — 1) the power of the M-test to detect departures from 
the null hypothesis, = 0, is always less than that of the i-test, but it is clear that, for the 
cases chosen, the differences in power are remarkably small. 
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Table 3. Power furtctions of the u- and t-tests 


(Single-tailed test, with a = 0-06) 


Size 

of 

sample 

n 

Ho. 

of 

samples 

m 

Values of p/tr 

1 

— 

2 

3 

M-test 

i-teet 

M-test 

i-test 

M-test 

i-test 

6 

3 

6 

0-240 

0-248 

0-242 

0-249 

0-692 

0-611 

0-696 

0-613 

0-879 

0-893 

0-881 

0-896 

10 

_ 

3 

6 

_ 

0-260 

0-263 

0-252 

0-264 

0-616 

0-623 

0-620 

0-624 

0-897 

0-901 

0-900 

0-902 


It is necessary, of course, to consider wbat is the accuracy of the approximation to the 
non-central w-distribution. Since this paper was completed, Mr Lord has kindly put at my 
disposal his tables of computed values of the exact power function and the ‘ standardized 
error’ of his test. His calculations are for the symmetrical or double-tailed test; here, we 
reject the null hypothesis if | /1 ^ tj*, where P{| 11 > = a. 

The following comparisons have been made: 


(a) Case w = 1, «. = 10 

Table 1 above shows that, for the approximation, v = 7-689. Interpolating with this 
fractional value in Lord’s Table 1 of the power function of ‘Student’s ’t (p. 67 above), 
we get the approximate values of the power shown below for /i/cr = 2, 3 and 4. These are 
compared with the true values, taken from Lord’s Table 3 (p. 70 above). 


Power of double-tailed tests, with a significance level, a = 0’05 


pl<r 

2 

3 


M-test; Approxiination 

0-417 



True value 

0-421 



t-test! 9 degrees of freedom 

0-431 

0-761 



In this case, with m=, I, the approximation was not expected to be Very good. Let us 
make comparisons for m > 1. Here Lord gives only the standardized errors, that is to say, 
the values oip — pja for which the power equals 1 — a. Thus Po,o6 is the value of fij<r for which 
there is a 0*95 chance of estabhshing significance, using the test at the 6 % level. 

(b) Case m — 2, n = 10 

Table 1 shows, for our approximation, that v — 16-151. Using this value to interpolate 
in Lord’s Table 2, it is found that = 3’86. The true value given by Lord in his Table 5 is 

also 3-86. 
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(c) Case m — 5 

For the approximation, v = 14-732 and hence frcm Lord’s Table 2 (p, 68), = 3-87, 

again agreeing to the second decimal place with the true value in his Table 6, 

(c?) Case m = 6, w = 3 

For the approximation, v = 9-312, giving p^-os = agreeing with Lord’s computed 
value. 

(e) Case m = 2,n — 6 

For the approximation, v = 7-474, giving = 4-19, against Lord’s value of 4-18. 

There seems little doubt that, if a mean range can be used to estimate cr, the approximation 
will be very good. 

7. The powee op the test based on the ratio op ranges, Wjw 

Turning now to the range-ratio test in the analysis of variance considered in §§4 and 6, 
we have to distinguish between the two set-ups—the random and the systematic—^for 
considerations of-power. Let us take the former and the simple case of m groups with n 
observations in each. If, as before, tr® is the variance between the groups and cr§ the variance 
within the groups, the observed group means will have a variance of (T^ '+crljn. With the 
usual notation, when + 0, g = oPT/ta is approximately distributed as 




1 

W 

s ~ 

a/u- 


1\ 

- i 


1 



. In. 




where q is the ‘Studentized’ range of a sample of size m and with v degrees of freedom. 
Hence the power of the g-test based on Wjw, to detect the presence of between-group 
variability measured in terms of can be obtained using the Pearson & Hartley (1942) 
table of the probability integral of q. 

This result could be compared with the power of the analysis of variance F-test under the 
random set-up (see Johnson, 1948). 

On the othe'r'hand, if the systematic set-up is valid, then the alternative hypothesis states 
that the m group means have different expectations, but have the same variance crg/n. Now, 
their range W is what may be termed a non-central range, and so W jw will be distributed as 
the ratio of a non-central range to the average of m central ranges. The distribution function 
of non-central range is found to be the sum of a number of multiple integrals, and except in 
the case of sample size of 2 and 3 is extremely complicated. The distribution of the ratio of 
non-oentral range to mean-central range is not easy to handle even with our approximations. 
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[Editorial Note. Since this paper was accepted for publication, a paper has been published 
by D. R. Cox {J. Soy. Statist. Soc., Series B, 1949, pp. 101~114), in which the distribution 
of range is approximated to by using a distribution with the correct first two 

moments. This method is distinct from that of Patnaik, who uses the distribution of x- 
When testing whether two variances are equal, Cox’s approach leads to the ratio of two 
ranges or mean ranges being distributed as F, whereas Patnaik’s approach leads to the use 
of the tables of percentage points of ‘Studentized’ range. Cox is mainly concerned with 
applications in problems of sequential analysis.] 
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distributions were all Pearson-type curves, and while these cannot represent all forms of 
departure from the normal that may occur in the tails of frequency distributions, they cover 
a wide variety of shapes; four of the six population curves are shown on p. 122 of Pearson 
(1931). It is clear that, at least, up to samples of size n = 10, the expectation of and 
therefore of remains remarkably insensitive to changes in the population and 

The value of cr^, which, however, is leas important than that of the expectation in its effect 
on the distribution of u, does change considerably from the normal-theory value but so also, 

I, 

Table I. Expectations and standard errors of the range estimator of cr, namely, u}Jd^ 


{a) Symmetrical distributions (types II and VII) 


k 


M 6 

n=10 

o 

1! 

1‘8 

Expectation 

0-993 

0-921 

0-839 

(Rectangle) 

S.B, 

0-265 

0-126 

0-068 

2-6 

Expectation 

1-008 ±'0-016 

0-983 ±0-010 

0-966 ±0-007 

(11) 

S.B. 

0-338 (500) 

0-232 (600) 

0-147 (600) 

3-0 

Expectation 

1-000 

1-000 

1-000 

(Normal) 

a.B, 

0-371 

0-259 

0-195 

4'1 

Expectation 

1-016 ±0-019 

1-002 ±0-013 

1-060 ±0-012 

(VII) 

S.B. 

0-434 (600) 

0-290 (600) 

0-276 (600) 

7-1 

Expectation 

0-966 ±0-016 

0-986 ±0-018 

1-046 ±0-016 

(VII) 

S.B. 

0-473 (1000) 

0-399 (600) 

0-348 (600) 


{b) Skew distributions (types III and I) 


An A» 


n= 6 

n-lO 

n = 20 

0, 3-0 

Expectation 


1-000 

1-000 

(Normal) 

S.B. 

0-371 

0-259 

0-195 

0-2, 3-3 

Expectation 

1-009 ±0-013 

0-999 ± 0-012 

0-990 ±0-009 

(HI) 

S.E. 

0-410 (1000) 

0-269 (600) 

0-206 (600) 

0-6, 3-76 

Expectation 

0-986 ±0-012 

0-967 ±0-012 

1-007 ± 0-007 

(HI) 

S.E. 

0-384 (1000) 

0-266 (600) 

0-222 (1000) 

1-0, 3-8 

Expectation 

0-968 + 0-012 

0-963 ±0-013 

' 0-933 ±0-009 

(I) 

S.B. 

0-392 (1000) 

0-296 (600) 

0-210 (600) 


Note. The results are given in terms of the population standard deviation as unit, The figures in italics 
are theoretical, the others were derived from aamplmg experiments. The sampling standard errors of the 
expectations are calculated from s^j^N, where is the standard error of wjdn observed in the N random 
samples. The value of N (500 or 1000) is shown in parentheses. 

* The symmetrioal distributions with fit ~ 1-8 (the reotangle) and /(?j = 7-1 and the skew distribution 
with fit, = hO, fit = 3-8 are exceptional forms not commonly^met mpractice. Abruptness at one or both 
terminals will reduce the expectation of the range estimator when the sample size increases. This 
effect appears in the cose of the rectangular distribution and also for the type I curve, which is very 
steep at the start. 
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of course, does the standard error of s. It is known that as n increases the standard error 
of s equals approximately the normal theory value multiplied by When 

= 20, the same factor may be seen to give roughly the empirical standard errors of the 
range estimator. 

8, In a recent paper, K. J. Shone (1949) has considered the relation between mean range 
and population standard deviation in samples of » = 2 to 6, from a number of non-normal 
populations. He found exactly, for n = 5, the following values for S’iwjd^cr) = wjld^cr): 


Population 

h 

A 

wl(dtcr) 

d\ 

0 

2-67 

0-973 

0 

1-78 

0-979 

G 

0 

-4-63 

0-926 

I 

0-68 

3-46 

0-968 

K 

0-85 

3-22 

0-937 


The population distributions each containing only seven discrete frequencies, spaced at 
equal intervals, were quite unlike those used in the sampling experiments referred to above, 
and it is probably for this reason that the values of wj{d^cr) differ considerably more from 
unity than those given in Table 1. The latter were based on samphngs from populations with 
a much more finely graded variable, and it is unlikely that any ‘grouping up’ could bring 
the two series into agreement. 


Effect of eogttb observations 


9. If the sample is large, a single outlying observation wiU in general have a much greater 
influence on the range than on the root-mean-square estimator of cr, but i,t is not immediately 
clear that this will be the case in a small sample. An illustration of the position can be obtained 
as follqsvs. Suppose that ajj, * 2 ,..., represent a random sample of n observations, arranged 
in ascending order of magnitude, drawn from a normal population having zero mean and 
unit S.D. Suppose now that an ‘error’ term a gets for some reason added to a:„, to make it 

The range becomes w = and the expectation of the range estimator is 

== 1-i-a/dn, (6) 

where is the tabled corrective factor. The mean-square estimator of cr® will be 


where 

It can be shown that 


s® = {x^ - 5)®+- a:)®| I {n-l), 

n 

nx = S (*<)+*• 


(?(s®) = l + a ^ jn + 2 a ^( Xn ) l ( n — l ), 
= l + a^jn+adj(n-l), 


( 7 ) 


where ^{x^) = is the expected derivation of the extreme individual in a sample of n 
from the population mean, when cr — 1. 

* This device gives a rapid means of examining the effect of an outlying observation, more 
reasonably, the error should be added at random to any one of the n observations and not to the 
extreme. However, this would complicate the calculation of ^{w). 
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10. When » = 4= 0, the value of (s) is not immediately obtainable, but it seems reason¬ 

able to assume that, approximately, 


S{s\a = %) _ f S’js^ [a == _ 


= {1 + 


n ■ 


la = 0) i^(5*la = 0)J 

In Table 2, the expressions (8) and (6) are compared for » = S, 10, 20, 30 and a 
1-0, 2-0, the population standard deviation being taken as unit. 


( 8 ) 


0-5, 


Table 2. Showing the effect on estimates of <r of the addition of an error term, aor, 
to the extreme observation in a sample, {cr taken as unity) 


Sample 

size 

n 

a = 

0-6 

a = 

10 

a 5= 

2-0 


V<?(«») 

S'{wld„) 

V<?(a>) 

iiwld^) 

' 

(f(w/d„) 

5 

1-16 

1-21 

mHKm 

1-43 

MHI 

mm 

2‘3269 


1-09 

1-16 


1-32 



3-0776 

20 

1-06 

1-13 

1-12 

1-27 


1-64 

3-7349 


1-04 

M2 

1-08 

1-24 

IB 

1-49 

4-0866 


It is seen that for a given error term, a, the expectation of the range estimator is more at 
fault than that of the root-mean-square estimator, and that, relatively, this bias increases 
the larger the sample and the larger the error a. If there is a single outlier only, and we break 
up the sample into groups when using the range estimator, the bias is very much reduced. 
Thus if thirty observations are broken into three random groups of n — 10, it will he seep, 
that <^(Mj 3 ,io/dio) has the following values: 


a 

0-6 

1-0 

2-0 

V<f(a*) (b=30) 

1-06 

Ml 

1-22 

1-04 

1-08 

M9 


The bias in this way is only a little greater than that obtained from the root-mean-square 
estimator, applied to the whole thirty observations. A mean range based on six groups of 
five, would be less affected still. 

11. In conclusion, these results may he regarded as supporting the case for using range, 
with the adjustment appropriate for a normal population, as an estimator of standard 
deviation provided that groups of not more than about ten observations are taken. 
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ON THE STATISTICAL INDEPENDENCE OF QUADEATIC 
FORMS IN NORMAL VARIATES 

By A. C. AITKEN. D.8o.. F.R.S. 

1. Intbodtjotoby 

The i-test, the variance-ratio test and certain other tests of significance are valid only on 
condition that the linear, quadratic or bilinear forms concerned are statistically independent. 
For quadratic forms, the variates being normal, uncorrelated and of unit variance, the 
central theorem is that of A. T. Craig (Craig, 1943; Hotelling, 1944), namely: 

Let X be a vector having for elements n uncorrelated normal variates each of unit variance: 
then the necessary and sufficient condition for the quadratic forms x'Ax and x'Bx to be statistically 
independent is that AB — 0. 

Some years earlier W. G. Cochran had obtained (Cochran, 1934, p. 181) the equivalent 
but less easily applied condition that 

\l-a,A-§B\=^\I-aA\\I^fiB\ (1) 

identically in the real indeterminates a, In the present note we shall derive Craig’s 
criterion from Cochran’s condition, and we shall point out some corollaries. 

2. Pboof OB’ Cbaio’s theobem 

The joint moment-generating function or Laplace transform of x'Ax and x'Bx is found at 
once (Cochran, 1934; Aitken, 1940) to be 

G(a,^) — (27r)~^”'f exp(~^x'x + ^ocx'Ax-f^/9x'Bx)dx—jI — ixA—^Bl~'K (1) 

J ~ 03 

provided a and /? are in a real region such that I — ocA - ^B is positive definite. 

The necessary and sufficient condition for independence, namely, that 

(?(a,;ff) = G(a,0) Q{0J), 

then 3 delds the condition quoted in § 1 (1). For convenience we shall write it in the homo¬ 
geneous form 

A”lA/-/>A-(rjB| = iAi-/5A|jA7-crB|, (2) 

where p, cr are the arbitrary (real) indeterminates, in a suitable region. This shows that the 
latent roots of the matrix pencil pA -f-rrlB are the latent roots of pA together with those of 
(tB, with the useful corollary that the rank of pA + aB is the sum of the ranks of pA and of aB. 
Also in the first place, and without loss of generality, we may suppose that an orthogonal 
transformation has been applied to the pencil, of such a kind that acting on A alone it 
produces a diagonal canonical form with the non-zero latent roots of A, let us say a, 
(i = 1,2,3,..., r) appearing in leading position in a submatrix A^. It is permissible therefore 
to take A as given in this shape. Further, this being done, it is possible that the rows later 
, than the rth in the transformed pencil may be linearly dependent among themselves. In such 
a case we could apply a further orthogonal transformation to reduce to nullity any redundant 
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rows, and the corresponding columns, thus removing from the problem any redundant 
variates. 

The problem is thus simplified to one in which, for real and non-zero p and cr, the pencil 
pA crB is of full rank n== r+3, where r is the rank of A, and s is the rank of B. Since the 
latent roots of the pencil are known, there exists an orthogonal transformation to canonical 
form, let us say 

Q'{pA^(rB)Q^]^^^ (3) 

where B^ must be diag . /?J, the being the non-zero latent roots of B. Let us partition 
B accordingly and examine the determinant of the penoU. We must have, identically in 
cr and p, 

pJli-t-crfiu cr^ij 

< r ^-^28 


Ml 


crB, 


(i) 


The coefficient of p^cr® on each side of this gives 

(5) 

Now B is of rank s, and so is B^^. Thus the following congruent transformation, involving 
a submatrix K, exists: 

r- 7 r'ry i5-ni^r ~i r* 

( 6 ) 


C aK c]=[: J- 


Appl 3 dng this to B-XI and constructing the characteristic polynomial of B, we have 
therefore 


\B~U\ 


~X.{I+K'K) ~XK' 
~XK B^^-U 


(7) 


The determinant on the right of (7) has a factor A*"; this merely illustrates the fact that r of 
the latent roots of B are equal to zero. The other factor of the determinant has | J + iC'if 11 -Bga | 
for its constant term, and this by matrix theory must be equal to ... /^g, that is, by (6), 
to I ^ 22 1. Hence 1 1+ K'K 1 = 1. Since K'K is non-negative definite, this can hold only if 
K = 0. Hence flnafiy by (6), 



( 8 ) 


Thus the submatrices the non-zero part of A, and B^^t non-zero part of B, are disjunct', 
and so AB = 0, as was to be proved. The sufficiency of the condition how follows at once 
from (2). 


3. ExOaSNSIOH TO CASE OE OORBBLATBD VABIATBS 

Next, let the elements of the vector x be variates obeying a normal law characterized by 
x'V-^x, where V is the variance matrix. Since F is positive definite, it admits a real square 
root F^. 

The transformation y = F"^a: then produces uncorrelated variates y, all of nnit variance. 
The quadratic forms x'Ax and x'Bx become, in the new variates, y'Y^AV^y and y'Y* BV^y- 
The necessary and sufficient condition for their independence is 

FMFLFiHF* = 0, that is. AYB = 0, 
the appropriate extension of Craig’s theorem. 
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4. The dependehoe oe a. quadratic and a linear eorm 

In the case of a linear form a'x with zero mean and a quadratic form x'Bx, the author derived 
a condition (Aitken, 1940) of independence, namely, that 

a'{V—^B)~^a should be independent of/?. (1) 

This result, however, like that of § I (1), could have been pressed further. Let us square 
the linear form, obtaining the quadratic form x'aa'x. By §3, the necessary and sufficient 
condition for this to be independent of x'Bx is that 

BFaa'= 0, which further yields BFoa'a = 0. (2) 

Cancelling the non-zero scalar a'a, we derive the simpler condition BFa = 0, which is easily 
seen to be sufficient as well as necessary. 


6. The independence oe bilinbar norms 


Bilinear forms y'Ax, y'Bx may be constructed from sets of normal variates either independent 
or interoorrelated. In either case we may pool the variates and then regard any bilinear form 
as a quadratic form in the combined set. Craig’s theorem can then be applied, and leads to 
various subsidiary theorems, which can be enunciated if desired; in practice, however, it 
seems easier to apply the theorem in its primitive form and not to particularize. 

We consider, however, a possible case. Let the elements of a: be r variates, those of y be 
the complementary s variates in a set of w = r -t- a variates having F for their variance matrix. 
Consider bilinear forms y'Ax and y'Bx. Apart from a factor 2 they may be written as matrix 
products, quadratic forms, thus' 






( 1 ) 


Partitioning V suitably, we may write down Craig’s condition of independence as 

r. A'irvn Fi^-ir. B'~\rA%^B A'r^^B'-\_ 

U . J lv'^^ fJ Lb . J “ L^f,,b av,,b’ J - 


( 2 ) 


This yields an easily applied criterion, which simplifies further in the case when = 0, 
that is, when the two sets of variates are correlated within, but not between, their respective 
variates. 


6. Coohban’s theorem on independent quadbatio forms 

Thus far we have not specialized the quadratic forms. Por example, we have not insisted 
that they should be non-negative definite. But in the theory of analysis of variance there is 
a theorem on quadratic forms (Cochran, 1934), in which conditions of definiteness are 
imposed. Formulated as a theorem on matrices, it is as follows: 

Given (i) that Ai-t-Aa-f... -f Aj, = I, where all the matrices Ai are real symmetric matrices 
of order nxn; (ii) that the ranks Ui of the A{ sum to n: then the separate Ai are idempotent, and 
there exists an orthogonal matrix H such that the non-zero parts of H'A^H are disjunct diagonal 
aubmatricea, with unit diagonal dements. 

The theorem admits a proof on matrix lines. Let us first apply an orthogonal transforma¬ 
tion J?! which would reduce to leading diagonal canonical form. We then have 

= •], Hi(A, + A3-f.,.-)-A,)Bi = [^~^ 


0 ) 
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But, since the rank of a sum of matrices cannot exceed the sum of the ranks of the separate 
matrices, the rank of Az+A^+... +Aj^ cannot exceed + and since the rank 

of the lower submatrix I on the right of (1) is certainly 112 + 713 +we must have 
l-D^ = 0, that is, = L In a similar manner we can proceed, transforming each successive 
A^, independently of its predecessors, to its disjunct canonical form of n^ unit elements. It 
follows that the A^ are idempotent, and that the quadratic forms x'AiX are independent 
sums of squares, are in fact functions of ^ type with respective degrees of freedom n^. 


7. The nruBPENDEHOB oe noh-neqative qttadbatic eoems 

In a paper that has lately appeared (Mat4m, 1949) it is proved that for non-negative quad¬ 
ratic forms x'Ax and x'Bx in normal variates a sufficient condition for independence is that 
the forms shall be uncorrelated. This, in the case of independent normal variates x of unit 
variance, is shown to be equivalent to the condition 

trAB = 0 , ( 1 ) 

where ‘tr ’ denotes trace or sum of diagonal elements. If the variance matrix of the vector 
X is 7, the appropriate extension of ( 1 ) is 

tr^FBF = 0. ( 2 ) 

Mat 6 rn ’8 result, for the case considered, implies Craig’s theorem. For in the first place 
sino® tr A VBV * tr (FM F*. F* J?Fi) 

we can proceed without loss of generality {§ 3) as if F were 1. But then also 

in virtue of the fact that a non-negative definite symmetric matrix has a non-negative 
definite square root. Since the matrix on the right is non-negative definite, the vanishing 
of its trace implies the vanishing of all ita diagonal elements, and this implies the vanishing 
of all the elements of A^BK Hence .415 » Ai.AiBKB* = 0. 

Thus Mat^m’s criterion, in the non-negative definite case, is equivalent to Craig’s, but 
simpler. 

The outcome is a criterion for the independence of non-negative definite quadratic forms 
which is perhaps the simplest of all to apply, namely: 

The necessary and sufficient condition for the independence of x'Ax, x'Bx is that all 
the diagonal elements of AVB (or BVA) shall he zero. 
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TWO COMBINATORIAL TESTS OF WHETHER A SAMPLE HAS 
COME PROM A GIVEN POPULATION 

By F. N. DAVID 

1. The question as to whether a sample has come from a given population may be answered 
in two different ways. We may take the sample and carry out tests of significance regarding 
the sample mean, the sample variance and so on, each time obtaining an answer which tells 
us about that particular facet of the composition of the population which is revealed by the 
given sample test criterion, but we obtain no picture of 'the population as a whole. The 
alternative method of approach is to specify the possible functional form of the population 
and the necessary parameters of this functional form, and by means of the criterion to 
test whether the sample could have been drawn from such a population. This latter test, in 
which the alternatives to the hypothesis tested may be whatever one likes—different 
functional form and/or different values for the parameters—appears to the writer most truly 
to answer the question ‘Could the sample have come from a given population? ’ The test 
does, however, suffer from the defect that it can only be applied to large samples because of 
the approximations involved in the derivation of its sampling distribution. Two tests are 
proposed here. The first is an omnibus test in which all alternatives to the hypothesis tested 
are regarded as admissible and which may he used instead of when the size of sample is 
very small. The second test, a variant of the first, is more sensitive because it allows us to 
specify broadly which departures from the hypothesis under test it is most important not 
to overlook. 

2. It will be assumed that the hypothesis tested, which we shall denote by Hq, is that the 
population, from which a sample of N observations has been independently and [randomly 
drawn, is a continuous distribution of specified functional form and with given parameters. 
We suppose that this population is divided into h groups or strata of equal probability, and 
we plot the sample points noting into which strata they fall. It is clear that if these points 
are very regularly dispersed among the h strata then we have a situation analogous to that 
producing a very small value for For example, if we make k — N and there is one sample 
point in each group, then expectation is exactly realized. On the other hand, if all the sample 
points fall into one or two groups there is obviously a big departure from expectation corre¬ 
sponding to a large value of We shall take therefore the number of groups containing no 
sample units—or if it is preferred, the number of groups containing at least one sample unit 
—as our test criterion. 

3. The mathematical analysis required to find the distribution of the zero, or the non¬ 
zero, groups is very simple. It is given in great generality by Laplace in his TMorie des 
ProbaJbilites (see also F. N. David, 1949). A simpUfioation of the function derived by Laplace 
was discussed and tabulated by E. M. Elderton & K. Pearson (1926) and again later by 
W. L. Stevens (1937). Stevens was concerned with a test for randomness, which, viewed from 
one aspect, is what the test proposed in § 2 is also. We postulate a box divided into k equal 
and identical compartments. N identical balls (JV < k) are dropped randomly into the box, 
any number of balls being allowed to fall into any one compartment. The number of ways in 
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which, these N halls can. arrange themselves in any k — t compartments, leaving t empty, 
can he shown to he equal to 

where is the (fc-i)th leading difference of the JVth power of the natural numbers 

0,1,2,3,..., etc. Hence the probability of t empty compartments, given N balls and k 

compartments, is 


hfl 


This result can be shown to be true also for N>k. 

4. The analogy between the box, compartments and balls, and the probability integral, 
the groups of equal area and the sample units is obvious. N, the number of balls, is fixed by 
the sample size, hut it is not immediate what value to choose for k, i.e, into how many equal 
parts we should divide our probability integral. Since this proposed test is to be used in 
a way analogous to y*, we recall the two different types of hypothesis alternate to that tested 
by the criterion. We test the hypothesis that the functional form of the population and/or 
the given values of the parameters are what they are postulated to be. If we use the upper 
tail of the y® distribution as a critical region then we have in mind as an alternative that the 
functional form and/or the given values of the parameters may be different from those tested. 
If we use the lower tail as a critical region, then the alternative hypothesis is complex and 
is concerned with the randomness or independence of the sample used for the test. The same 
situations obtain for the zeroes test and it is necessary to hear them in mind in choosing the 
value of k. 

If k is chosen to be less than N we curtail the range of the probability distribution of the 
zeroes without achieving anything in compensation. The test will be insensitive in both 
directions and zero groups will be few, even when the functional form of the population is 
the correct one. This would suggest making the number of groups large. However, if we 
take k>N the test will become insensitive to alternatives of the kind picked out by a very 
low y®. For ii k>N there will be always at least k — N empty groups, no matter how the 
balls are distributed. It would appear, therefore, that the best balance to the test will be 
obtained when the number of compartments is equal, or nearly equal, to the number of 
balls. We illustrate this point in Table 2 with a sample of 5. Clearly if ifc «= 6 there would be 
the possibility of establishing significance at either tail, even when N is as small as 5. This 


Table 2. Variation of ‘probabilities of zero groups as k, the number 
of compartments, varies. {Sample size iV = 6) 


' 

No. of 

Compartments 

aero groups 

3 

6 

8 

0 

0'ei73 

0-0384 


1 

0-3704 

0-3840 


2 

0-0123 

0-4800 


3 


0-0960 

0-2051 

4 


0-0016 

0-6127 

6 



0-2663 

6 



0-0256 

’ 

' 


0-0002 
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ia not the case for N = S ov 8. This question of the appropriate number of compartments 
to use is, theoretically, capable of solution by the use of power function technique, and the 
attempt was made to do this using the power function given in a later section. It is, however, 
proposed to use the test only for small samples, where the test is not vahd, and with these 
small samples the effect of discontinuities renders accurate comparisons between the power 
of the test for fixed sample size, but varying numbers of compartments, almost impossible. 
Calculations were carried out, and the suggestion which comes from them is that, for a fixed 
sample size, increasing the number of compartments tends to increase the power of the test 
using the upper tail of the sampling distribution but decreases the power of the test using the 
lower tail. We cannot state that to take the number of compartments equal to the number of 
balls is the optimum solution to the problem—it is possible that there will be a different 
optimum solution for each sample size. We can, however, state that when h = N the two 
tails of the distribution are reasonably well balanced and we shall adopt this for our test. 
The proposed test will consist therefore of the following steps: 

(i) Divide the probability integral into as many equal groups as there are units in the 
sample. (This is easy for any well-tabulated function.) 

(ii) Count the number of groups containing no sample units. 

(iii) Refer to Table 1 i to judge whether the number of zero groups is too small or too large. 

The function WAV-inw 


is tabulated in Table la and the (nominal) significance levels in Table 16 for iV - 3 to 20, 

5. The zeroes test presented above will undoubtedly be insensitive, just as x® is insensitive, 
when compared wuth any test which is specifically designed to test a possible given departure 
from Hq. The power function for the case when Hg is false and an alternative hypothesis 
is true may easily be written down. We shall denote by 


P{a^a^...a^) == 


m 

(l!)“tai!(2!)“2a2!...’ 


j i . 

t, S ia^ = N, 


the elementary partition function giving the number of ways in which N balls may arrange 
themselves in t compartments so that compartments contain one baU each, an compart¬ 
ments contain 2 balls each,..,, compartments contain j balls each. This is the same function 
as that denoted by David & Kendall (1949) as the augmented symmetric function, and we 
note that .fON 

••• ~ I 


the sum being taken over all possible partitions of N by t. Letj^j, p^, the probabilities 

of a sample unit falling into the first, second,..., groups under the alternative hypothesis 
Writing Pj for the probability of t zero classes under Hi, we have 

Pn-1 = , 

r,s i+i 

■PiV-3== S 

r,B,m i+i+ft 


Pu = SS... S PiPj ...Pf [N summations), 
+/ 
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where obviously 

and we write 

We may deduce then that 


k 

= 0 , 

i=X 

k 

S a| = a. 
<=i 








( J 

J 


if we neglect terms involving sums of powers of a* for s > 2, We do not know what the dis¬ 
tribution of s under will be, but for small departures from Hq we shall not expect normality 
to be greatly upset. We shall therefore assume that the distribution of x under is normal 
with mean and variance as given immediately above. 

To get the power of the x® teat we follow Patnaik (1949). If we assume that the probabilities 
under lEfj are ...,TTk and under i?i are Pi.Pa, .-..Pfc, then Patnaik showed that the 
quantity ^ (Observed—Expected)® 

All gcoupa Expected 


is distributed approximately as non-central x® "with parameter 


and degrees of freedom k-l. He gave tables from which, knowing A and fc -■ I and the signi¬ 
ficance level of rejection under fl),, the power of the x® test to detect the alternative hypothesis 
can be evaluated. Similar tables have also been calculated by E, Fix (1949). 

We shall take the case of a sample of 30, and for illustrative purposes we take the hypo¬ 
thesis, Hq, that the sample has come from a normal population with zero mean and unit 
standard deviation. will be that the sample has come from a normal population with zero 
mean and with standard deviation f. For the zeroes test we take fc = 25 and we find for a 
6 % level of rejection under that the power of the test to detect the alternative hypothesis 
is 0'183. For the x® teat we divide the unit normal curve into six groups of equal area, thus 
ensuring an expectation of 6 in each group, ^ for i = 1,2,6, The quantities fi are 
calculated corresponding to the dichotomy under We obtain A = 2-477, &~1 = 6 and 
interpolation into Patnaik’s tables gives us the power as approximately 0-189. We see then 
that the power under the two tests is comparable. 

Both the approximations to the power functions given above will hold (strictly) when the 
alternative hypothesis is not very different from the hypothesis tested, Numerical calculation 
has shown that Patnaik’s approximation to the power function of x® will give reasonable 
results for the power even when the alternate hypothesis is some way removed from that 
tested and in consequence the power is large. Thw unfortunately will not he the case for the 
approximation proposed for the power of the zeroes test and another approach is necessary. 
As the power of the test increases it will he found that a few of the p^’s become large and the 
remainder very small. For example, when the hypothesis alternate to that tested is that 
there has been a shift in the population mean to the right, then as the divergence becomes 
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large 1 S’l'-d. all the other p’s tend to 0, This suggests that we expand the moments of z 
in ascending powers of the p’s, most of which will qrdckly become negligible. Thus 

,^(z) = I (l-Pi)^ = i-^CiSpi+^0,Sp2-^f73Sp? + ..., 

i=l 

h h 

S[z{z-l))== S s (l-p,-p^)^=fc(fc-l)-^OiSS(p,+pj)+^C,SS(p,+p/-.... 

1=1 i=i 1+; i^j 

l+J 

The double sums may be reduced to single sums and we have 

SS(Pi+p^) = i:-H-S{i!-l)p„ 
i’¥j i 

S S (Pi + p^f = 2 + 2S (A: - 2)p|, 

1+1 1 1 
SS(Pi+p^)s = 6Spf+S(2fc-8)pf, 

1+1 i i 


by making use of tables of symmetric functions. This procedure will be adequate for large 
divergencies from the hypothesis tested. It should, however, be used with caution because 
the assumption that z is normally distributed under need not necessarily be true in 
these cases. 

9. The test for the counting of the number of zero classes supposes that the functional 
form of the population under Hq is specified and the parameters also. But if sample moments 
are used as estimates of the parameters, the distribution of the number of zero classes will 
no longer be that given above owing to the restriction of the sample space. The test is therefore 
kmited in application, a fault which it shares with most goodness of fit tests which have been 
proposed, the classic exception of course being Recent work by David & Johnson (1948) 
on the probabihty integral transformation suggests that when x is subjected to two sample 
moment restraints, the transformed variable y defined in § 6 cannot be regarded as being 
effectively rectangularly distributed until N > 30. The procedure suggested above therefore 
wiR probably not lead to grave risk of error when one or two moment restraints are placed 
on the sample space, provided the sample size is greater than 30. Whether one would wish 
to use the zeroes test in such a case is a matter of opinion; probably the simplest thing would 
be to apply the x® test as suggested earlier. 

10. It will be recognized that the zeroes test proposed above is another addition to those 
tests of significance and of goodness of fit which are based on the probability integral trans¬ 
formation. E. S. Pearson (1938) discussed the theory of tests baaed on this transformation 
in some detail and pointed out that in order to overcome the lack of power associated with 
‘ omnibus ’ tests it is necessary to define the way in which there may be departures from root- 
angularity, in order to devise tests which will be sensitive to these departures. We shall stRl 
consider, in this second test proposed below, the configuration of the zero classes in the 
sample, but we shall associate certain broad types of departure from the rectangular hypo¬ 
thesis with certain configurations of the zero classes, thus going some way towards satisfying 
the requirements laid down by E. S. Pearson. Suppose, for the sake of example, it is desired 
to use the zeroes test to take account of a possible shift in location of the population mean. 
If all the compartments to the right of the distribution are filled and none of those on the 
left, then it would be reasonable to suspect a shift in the population mean to the right. Again, 
if all the compartments in the centre of the distribution are filled, and none of those towards 
the two tails we might suspect a reduction in the population standard deviation, and so on. 
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We shall therefore base out second test on the configuration of the zero compartments in 
k specified compartments. These k will be selected before the analysis of the data, as being 
the most hkely for an alteration in the number of zeroes to occur in them if the hypothesis 
tested is not true. We have again to face the question as to what should be the value of k to 
H.im at. Presumably, arguing as before, we should now aim at making k, the number of 
specified compartments, equal to N, the number in the sample, and it will be undesirable 
to have the number of unspecified compartments, > W or <N. We shall therefore divide 
the probability integral into 2N compartments and we shall choose k ~ N oi these for the 
test. In this test the presence of too many zero classes in the specified N groups will lead to 
rejection of the hypothesis tested. The presence of too few zero classes will not lead, however, 
to a suspicion of a lack of randomness, as it did in the test proposed earlier, but probably to 
a questioning as to whether the alternative hypothesis proposed is in fact the appropriate 
one to take into consideration. 

Thus, if a ohapge in the mean is suspected, we shall consider the configuration of the zeroes 
in the left-hand N or the right-hand N compartments, according to the direction in which 
the change is suspected. If we wish to take account of a change in the standard deviation, 
the mean being the same, then we shall divide the 2^ compartments into three classes, 
the sum of the compartments in the outer two classes being N, and so on. 

11. Our problem then corresponds to that of dropping N balls at random into 2N com¬ 
partments and of finding the probability of 0,1,2, ...,W zeroes in any specified N com¬ 
partments. It is clear that the total number of arrangements of the N balls in the 2N 
compartments will be (2W)^. Let z be the number of zeroes in the specified N compartments 
and let be the number of ways in which z may arise. We have then 

, Nl AO^ , m ^ N\ ,,,, 

1! ■^(W~2)! 2! rl ^ ’ 

and generally 


A 


N~s 


N\ ^ A-'O^^ m 

[N-8)\ ", r\ (N-r + s)\ 




with Aq~N\. 


The probabihties of 0,1,2,..., JV zeroes in the given N compartments are given by dividing 
the appropriate terms by (2JV)^. The probability function is tabulated in Table 4 a and b. 

12. Example I. A sample giving values - 8, +7, + 1 , + 10, +1 is assumed to have been 
drawn fcom a normal population with mean, g = 0, and with standard deviation o- = 10. 
Test this hypothesis against alternatives which assume that g > 0. 

From Table I of Tables for Statisticians and Biometricians, Part I, we read off the lines of 
dichotomy to be -od, -12-8, ~8'4, -6-2, -2-6, 0, 2-6, 5-2, 8-4, 12-8, -too, and find that 
sample points fall in groups 3,6,8 and 9 counting from left to right. For alternative hypotheses 
making ^ > Owe take the left-hand five compartments, in which there are four zeroes, and find 
from Table 4a below that this is not an uncommon configuration. In fact, the probability 
of four or more than four zeroes is 0-264. Table 46 shows that for a sample of size 6 significance 
will only be established if all five compartments specified are empty. 

Example II . A sample of 4 units is assumed to have been drawn from a normal population 
with mean 4=0 and standard deviation cr = 10. The hypotheses alternative to that tested 
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assume that there has been a reduction in the population standard deviation. Our lines of 
dichotomy are —oo, —11'6,6-7, —3'2, 0, +3-2, +6-7, +11’6, +oo and we decide to 
take groups 1, 2, 7 and 8 to test our hypothesis. The sample values are - 6, 0, 2, 2. 

We choose our test compartments before looking at the sample values, an important point. 
It is seen that no sample points fall into the teat groups so that z = 4 and we may therefore 
reject the hypothesis that the parent population is described by a normal curve with mean 
1 = 0 and standard deviation o- = 10 and proceed under the assumption that the normal 
curve describing the population will have ^ = 0 and tr < 10. In proceeding in this way, we 
shall in fact be wrong on the average six times in every 100 occasions. 

13. The factorial moments of the distribution of z may be derived in straightforward 
fashion. We know that 

N) /\»VN 

(N-3)13112^ « = 0,1,...,W. 


Writing (W —sp' = (N — s){N—s~l) ...(N~s—k+l), 

it is immediate that ^ 

= s ^ s 

*=0 (-iJS) 8 = 0 

= _ (1 + \W-k Nff = —I.-.- m-k]^N 

We notice that when k = 0 the result is unity as'expected. When k = Iwe have 

and we deduce from = 2 that 

momenta which hear certain similarity to those quoted for the first test. Higher moments 
can be deduced, if required, from the general formula given above. 

14. The shape of the distribution of z for W = 10 (given in Table 4 a) suggests that the 
normal curve may be a good approximation. A comparison between these exact values and 
the values obtained from a normal curve with moments as given in the preceding section is 
given in Table 5. A continuity correction is necessary. It will be seen from the table that the 


Table 5. {Distribution of N balls in a specified N otit of 2N compartments.) 
Comparison of exact values and normal approximation for N ~\0 


z 

Exact 

Normal 

% 

Exact 

Normal 

10 

0-0010 


4 

0-0901 

0-0920 

9 

0-0166 


3 

0-0176 

0-0196 

8 

0-0881 


2 

0-0016 


7 

0-2334 


1 

0-0001 


6 

0-3194 


0 

0-0000 


5 

0-2332 

0-2326 
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agreement between exact values and the normal theory approximation is good enough for 
practical purposes. It is suggested, therefore, that for samples greater than 10 the normal 
approximation may be used for teats of significance. 

15. The derivation of the power function of this second teat presents little difficulties in 
reasoning, although it is laborious to write down. In most combinatorial problems it is often 
easier to write down the power function and from it deduce the probability distribution of 
the criterion when the hypothesis tested is true. The fact that the probabilities are different 
for all compartments makes it difficult to overlook certain combinations which are aU too 
easily passed over when the probability is the same for aU compartments. Let the probabilities 
for the N compartments specified for test h&Paj>,PbT,PcT> ••■y!PNT> ^’^6. let the probabilities 
for the other compartments left be PbL> • Given these probabilities we have 

P{z = i^} = + S S S 2 pIi^p%lP'ol+ 

a r,aa,b r,a,ta,b,o 

N N N 

where S stands for S S S, etc., 

a,b,o tf=16=»lc=sl 

and aU summations unless explicitly stated otherwise run from 1 to N. The outside sum¬ 
mation S ill each case is taken over all possible partitions of N, excluding zero as a part, 
It is easy to show that the above expression reduces to 

Using the partition notation of § 6, we may write down the other probabilities for z. We give 
the expressions for z = W-1 and z == N—2, the others may easily be deduced in a similar 
fashion; 

P{z = iV - 1} = S - 1 - S S S P[ai, a^) (p^pgV+pgirPsi) 

a a„at a b 

+ S P(av Ua, Ug) ( S S pSiP6hP??r + 2 S P^pI'tP% + 2 S p^TPblPli] 

aiiOtiO, \a,b c a,cb b,c a / 

+ S P(ai,a2,as,a^)( S '^P^php'tPdl+ 2 '^Pl'zP^PclPdL 

dxt (ht dx \htCid a a,Ctd b 

+ 2 2p“i;P“hPMt+ 2 Sp2hP6hP?i;P&) + eto. 
a,b,d 0 a,b,o d 1 

For the sake of simplifying the arithmetic, the multiple sums can be expressed as products 
of the one-part symmetric functions (i.e. power sums) from David & Kendall’s tables. Again 

P{z = A — 2 }= S P(®iin' 2 ) 2 p2!rP6lr+ S .Ply'll ® 2 > * 3 ) 

OiiO> a,i> a,, Oi.a, 

va.o c a,c b b,c a } 

+ 2 P{^v<^ 2 ,o- 3 ,a^)\ 2 pS'pPfc’p 2 all possible pairs of products 1-1-etc. 

ai,aj,a>,o, \a,b o,d } 

The final term will be 

P{z = 0} = S PaVPbTPcT • • ■ PnT- 

a,b, ...,N 
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16. The formal expressions for the first two moments of z are immediate. We have, in 
general, for N balls and ]c compartments 

a=l 

a=l 

a+6 

We note that if all the p’s are equal to l/(2&), we obtain the moments of § 13. A technique 
similar to that used previously will give these moments in reasonable form for the case when 
the difference between the two hypotheses, Hg and H^, is small. Thus we write 




whence 


and 


i=l i=l 

k k 1 fc 1 

{=1 t=l 4/2 


Hence, assuming 21 a\ is negligible for a > 2, 

k ^ \ \N 




i=l * 




N-i k 


Saf, 

i=i 


where we write i for simplicity instead of the subscript aT. The summation is taken over all 
the compartments assigned for test. Again 

/ 1\-''^ / i\w-i ft ft WfiV-lW 

^(z(z-l)) = jl:(fc-l)^l-ij S^(a,.+ «,•) +£S(«, + a/, 

i^J fc 

and S E (a^ + a,) = 2(A; — 1) / — 

i+} \i=l '/ 

S S {cc, + = 2{k - 2) (Spt- isp, + ~) + 2(Sp, - 

We need thus only evaluate the corrective terms containing the a’a in order to obtain the 
mean and by deduction, the variance, of the distribution of z under Since we have shown 
that z is approximately normally distributed under Hq when N ~ k — 10, and since we have 
assumed is not very different from it appears reasonable to assume that z is approxi¬ 
mately normally distributed under with mean and variance as given above, where k is 
put equal to W. Such assumptions will enable us to obtain the power of the test for samples 
of 10 and over without recourse to the laborious working out of the appropriate terms of the 
power function. When is very different from 1% and the power is large—the case most 
often needed in practice—will usually be very small and expansions therefore of S{%) 
and (f(z(z— 1)) in terms of the p’s will not be laborious to evaluate numerically. We note, 
however, as for the previous test, that it is not known whether the assumption of normality 
will hold in this case. 

17, For the sake of example we compare the power of the zero test to detect an increase 
in the population mean with that of the power of the test which would undoubtedly be used 
in practice based on the sample mean. We take the sample size of 6. The power function 
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obtained by assuming the sanaple mean is normally distributed about the population mean 
with standard deviation equal to aj^n is drawn out in Fig. 1, and also P{z — 6}, both for 
the alternative hypotheses that the population mean has increased. The risk of rejection of 
the hypothesis when true has been fixed in both cases at 0'03126. When the orthodox test 
gives a power of 90 %, the zeroes test has a power of 66 %, a satisfactory result considering 
the broad class of alternative hypotheses to which the latter test can be made to apply. 



Shift of population mean in multiples of o 

Pig. 1. Power of tests to doteot a change in the population mean. 
-orthodox teat with sample meanj-zeroes test. 


Prof. Pearson has pointed out to me that in applying the zeroes test in this way, i.e. to 
detect a shift in the population mean, I am using here an interesting variant of another test. 
It is known that a quick approximate method of testing whether there has been a shift in 
the population mean is to see how the sample units fall about the mean, g, specified by the 
h 3 rpothesis tested. If all the sample units fall to the right of ^ then the orthodox test using 
the sample mean will be likely to give a significant result, unless of course there has been at 
the same time a reduction in the population standard deviation. The zeroes test consists in 
noticing how the sample units fall about the population median. Table 4a shows that for 
samples of 7 and less it is necessary for all observations to lie on the same side of the median 
in order to obtain a significant result. For samples of 8, 9 and 10 one observation may lie 
on the opposite side (or two or three or more proidded they are all in the same compartment). 
For more complex alternative hypotheses the rules that could be laid down become more 
complex and it is easier to note the groups into which the sample points fall. 

I should like to thank Prof. F. S. Pearson for the idea of the second test described here 
and for much helpful criticism. 
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Two GomhincUorial tests 


Table 16. Suggested significance levels for the distribution of z as given in Table 1 a 



N.B. The figures in parentheses are the resulting probabilities of wrong rejection. 


Table 4a. Distribution ofz, the number of zero groups, in any specified N 
out of a total of iN compartments 



Table 46. Suggested significance levels from Table 4a 
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MAXIMUM LIKELIHOOD AND THE EFFICIENCY OF THE 
METHOD OP MOMENTS 

By L. R. SHENTON 

1. Introduction 

One of the practical difficulties in estimation by maximum Ulielihood arises from the fact 
that, except in special cases, the resulting equations are complicated and not easily solved. 
The present paper approaches this problem by deriving an expansion based on moment 
approximations to the likelihood equations. These are also not easy to solve explicitly, but 
they furnish a method of deriving the efficiency of the method of moments in terms of an 
expansion of the determinant of the information matrix. The efficiency of moment fitting 
as applied to Pearson’s distributions has been discussed by Fisher (1921), who more recently 
treated the case of the negative binomial (Fisher, 1941). 


2. The likelihood equations and orthogonal polynomials 

Let P{x; 01,6^, be the probability of the variate x, depending on s parameters 6^ 

{j = 1,2,...,s). We shall assume that P{xi dj) possesses first derivatives with respect to the 
dp and that its moments /<(! and their first derivatives exist and are finite. In this case 
(Kaomarz & Steinhaus, 1935) it is possible to construct a system of polynomials 


q^{x)=^ArjX^ (A„ + 0, r= 0,1,2,,.,), 
which are orthogonal with respect to P(a:; 6), satisfying 


= 0 (r4=.9), 
+ 0 (r = s),. 


( 1 ) 

( 2 ) 


or S^,.g-gP(a:: (?) = 0 (r + 5),| . 

+ 0 (r = s),j 

where the integral includes finite summation for a (discrete variate. These may be replaced by 

J?r &)dx = 0 [r> s)f 

4= 0 (r = s), 

with a similar expression for (3), where ^^(x) is an arbitrary polynomial of degree j. 

It is convenient to assume for the form 


q^ix) = S B^{xi-fij) (r = 1,2,...; ^0 = 1), 

where jig is the sth crude moment of P(a;; 6). 

Choosing <pj{x) = x^, the orthogonality conditions lead to 

EPr/(P/+fe-pJP*) = ^ (ifc= l,2,...,r-l). 
r 


-jq?P(x; 0)dx+^:EB,^(/i;^,-My/4) = 0. 


(4) 

(5) 

( 6 ) 
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Writing for sample moments, we have 

N cov (mj., m’g) = /ir+g-~ {'>'>«) say, 
where N is the number in the sample, so that from (4) and (6) 


qr{x) = 


X^~y'r 


... x-ii\ 





(^1) 

(r-1,1) 

... (1,1) 


(r-1,1) . 

• (1,1) 

. (7) 

df) 

(r-1,2) 

... (1,2) 


(r-1,2) . 

■ (1,2) 

(r,r'-~l) 

(r- l,r— 1) 

... (1,»--1) 


(r-l,V-l) . 

. (l,r-l) 



and from (5) and (6) 


(qfP(x] d)dx — { — )'■'’- 

(r, 1) (r-1,1) . 

(r,2) (r-1,2) . 

. (1,1) 

■ (1,2) 

— 

(r-1.1) . 

• (1,1) 

V 

(r,r) (r-l,r) . 

. (l,r) 


(r-i.r-1) . 

. (l,r-l) 


= say. 

•Suppose further that 
where Pj,sP(a;; 0). Then 




dd, 


(j = l,2,...,a). 


fc=0 




dd, 


^q^dx == {j = l,2,...,s;r = 0,1,...) 


=J 


^jr 

Ot/j j:„i 


r g 

= SPfc 

1=1 


ddj' 


r g 

X^Pffix— S /^k^rk Eff 


J- 


P^dx 


dj4 

ddf 

(r,2) 


¥r-i 

dd, 

(r-1,1) 

(r-1,2) 


(r,r-l) (?--l,r-l) 


ddf 

( 1 , 1 ) 

( 1 , 2 ) 

(l,r-l) 


(r-1,1) 

(r-1,2) 


( 1 , 1 ) 

( 1 , 2 ) 

(1,»--1) 


( 8 ) 

(9) 

( 10 ) 

( 11 ) 

( 12 ) 


since 


jP-^dx = 0 provided the range of values of x is independent of the Op and where 

have assumed it is permissible to differentiate under the integration sign. Clearly Gj^ = 
Now the maximum likelihood equations for the estimation of the parameters 6^ are 


we 
= 0 . 




0 “ ^'m-0 .">■ 


the summation being over the sample. 

From (9) we have the following formal expansion to determine optimum statistics: 


<^dA-K) + Gj 


'ji 




nf'3~'M'S 

K-Pa 


1 

i 


(S,l) 

(2,1) 

(1,1) 

(2,1) (1,1) 

•4- Cmo 

(3,2) 

(2,2) 

(1,2) 


( 1 , 1 ) 


( 2 , 1 ) ( 1 , 1 ) 
( 2 , 2 ) ( 1 , 2 ) 


+ ... =0 


(j = l,2,...,a), (13) 
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where Ojr is given by (12), and {hJ) = N cov{m']f,m'i). The equations (13) will in general be 
very difficult to solve, and from a practical point of view of doubtful value. To use them at 
all we must curtail the series at a certain stage and assiune that the remainders are negligible. 
Further, since the sampling variance of m'^ is large for s > 4 or 5, the inclusion of additional 
terms to improve mathematical accuracy will partly defeat its own object. The most suitable 
application would appear to be to large samples when the number of parameters is one or 
two; even in this case the usual method of using an inefficient estimator and successively 
approximating from the likelihood equation may be simpler. We turn to the main object of 
the paper which is an expansion for the efficiency of the method of moments. 


3 . EiririoiEiroY of the method of moments 

Using the first s sample moments to estimate the s parameters, we have (Fisher, 1941) for 
the efficiency Ef 

% 


\E\ 


V 1 Si’.SPUj 

varSj 

OOV(5i,02) .. 

. coy(di,dg) 

iPldd^ddJl 

ooy 

var(02) 

. coy{ds,d^} 


j cov(5j,5i) cov(53,^a) . 

. var (d,) 

ri dpjp;]\. 
iPldd, ddjy 

[oov (»,<)] 1 

■ A)Y 

’ 


(14) 

where Dj are consistent estimates of obtained from the sample moments, is a matrix 
with j, h = 1,2,.... s and is a Jacobian. 

But from (9) we have 

= (j,fc = i,2,...,8). (16) 

Hence from (14) and (16) 


A = 1 






)1D 

SC?, A 

Ok\ ^aJ 







Gil 

... 17,' 



^11 '^21 

Og-l,! 

^s+1,1 

On 

O 22 

- On 



Oiz On ... 

C'8-1.2 

^i-M,2 

, 4. 


... 4 



On 

Og~l,a 

Oe+l,B 





Gil ... 

^8+1,1 Os,l 

2 




4" 

On 

f4a 

^8+1,2 ^8,2 

^1^2 

■ 




ks 

4* 

^8+1,2 Og^g 






> m 


where we have used ddjdfi' for the Jacobian appearing in (14), and where the determinants 
are of order s x s whose terms consist of all distinct combinations of .s from 1,2, 3,..., etc., 
used in the determinant ' 


Op\ 

0,1 

Or3 

... a«i 

2 

0^2 

0,2 

Or2 

•. • Ao2 


C^s 

is 

is 

... G^s 



with p, q, r, etc., as positive integers. 
Biometiika 37 
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The first term of (16) after elementary operations on rows and columns of the determinant 
reduces to 



1 d/i' 



<Ps= 1- 


Since = 


and is essentially positive for the range of values of x for which it is 


defined, it is clear that is positive. Hence (16) consists of a series of positive terms, the first 
few of which will provide a lower bound to IjEf or upper bound to Ef. In general it is quite 
sufficient to use the first two or three terms. 


4. AppiiiOATioir 

As an example of the foregoing we take a ‘hypergeometric’ distribution recently discussed 
by J. G. Skellam (1948). Prom it, as Skellam shows, the negative binomial distribution may 
be found as a limiting case, for which the efficiency of the method of moments has been given, 
Taking the binomial distribution 


where the probability varies according to the law 

^[p] = (1 (0 ^ 1), 

with h a constant and a and f any real positive values, Skellam arrives at the probability 
function 


with 


P(a;; ctj) = 



(a+x— 1)^*1 


{^ + n~x—1 )<"'-®) 
(a + /5 + «--1)^”^ 


»+l) Mid (ff-»+l). 


(17) 


It is assumed that to is a known positive integer, so that there are two parameters a and /? 
for estimation. If the value of n is also to be e.stimated the derivation of Ef will be slightly 
more complicated. The distribution (17) may be regarded as a negative hypergeometrio, in 
the sense that in the usual form of the hypergeometric probability distribution 


ifr{x) = 




we need only put Np = —a, Nq = The negative binomial follows by putting /? = njc 
and letting n->oo. Using known properties of the hypergeometric distribution and its 
associated orthogonal polynomials (Aitken & Gonin, 1935), we have 


S Pj’^ = F(-n,oi; a+p) 1-1), 

a;=0 

g,(a3) = P(TO-r + l,-a-r+1; -a-/?-2r + 2; -A,j)a:^'‘), 
^ „, nW(a+r-I)W(;g-fr-l)W(a+/? + r+TO-I)W 

(a + ;^+2f-l)W(a + /?H-2r-2)W ^ 

where E[aM o, d) ^ ... 

lie 2!c(c+l) 


(18) 

(19) 

( 20 ) 


and 
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Putting 


9a 


S ■^rS'r-^i 


0P^ 


9 /? 

it may be seen that Jio = = 0, 

( -Y-^vP">{lS^r- If) (r-1)! 


(a + f+2r-2f)(a + /? + r-l)W’ 


- Y^B^qrP. 

-w(’-)(a + ?--lf)(?--l)! 


Using (18) for the factorial moments we find 

_ g(/<l./4) _ 

d{a,P) 


(a+/?+2r-2)fr)(a + /?+r- l)fr)- 


D say. 


0(a.^) (a+^)3(a+;5+l)2 

so that estimating a and ft by the first two factorial moments of the sample, we have from 


(20), (21) and (16) 


Er 


1 + 




[|J; 






-^z 
B. Bn 


i4>z+ 


"^1 ■^4 


s. 


3 




= 1 + 


4(w-2) (a + ^+l)(a4-^+3)(a + f+5) [cc-ftf 


+ , 


3(a + 2) (^ + 2) (a + ^ + 2)^ (at -pa + yS + 2) 

2(?t-l)2(a + l)(^+l)(a+^)(a + yd + 4)2(a + yffH-5) 

3(a + 2)(;d + 2)(a+f+l)a(a+f + 2)«(TO + a + yff + 2)(2) 
3(re-2)(»(a + f+l)(a+A+7)[(a + 3)(3)+(yd+3)<3>f 
(a + 3)(2) (/? + 3)(2) (a+f 4- 2)3 (a+/? + 3)3 (w + a+yd + 3)<3) ' 


( 22 ) 


From (22) it can be seen that: 

(a) The general term associated with 


! (^ + 'S) is of ft® form K‘d’’^'rY^Hn^{n — 1), 


where K does not contain n, so that for all admissible suffixes except r,s = 1,2, we see that 
(«-- 2) is a factor. Hence when n = 2, Ef= 1, so that the moment solution is efficient, a fact 
which is otherwise obvious. 

(6) If a and ft are both small then 


Ef^ = l + 


7 (to-2)(w-3) 

18(« + 2)(w + 3)‘*''‘‘’ 


which for practical values of «, say < 20, suggests that E may not be below 80 %. 
(c) If a is small, ft not small, say > 1, then 


4-1 = 


2{n-2)ft\ft+l){ft + 2){ft + 5) 
3(»+/? + 2)(/?+2)3 


which very rarely reduces 4 below 70 %. 

(d) If a and ft are both large, the relative degrees in a and ft of the numerators and denomin¬ 
ators suggest high efficiency. 

Thus the discrete ‘hypergeometric’ type distribution (17), depending on two parameters 
a, ft, with range n (assumed known), is simple to fit by the first two factorial moments, and 
this method of estimating the parameters rarely has low efficiency. (It is suggested that the 
first four terms of (22) should be used in any practical case.) We may mention that Mood 
(1943) gives this distribution in connexion with sampling inspection plans, and remarks on 
some of its properties. 

Skellam’s example on the secondary association of chromosomes in Brassica is 


No. of associations a: = 0 1 2 3 

Frequency 32 103 122 80 
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for which Skellaro. finds: 

(«) a = 6-168, yff = 4-456 by momenta, 

(6) ‘improved’ maximum likelihood estimates, A = 6-12, 0 = 4-42, 

(c) y? = 0-76 for both methods of fitting. 

It is clear that the improvement introduced by maximum likelihood methods is neghgible, 
indicating high efficiency for the method of moments. Putting a = 6, /? = 4-5, n ~ 3 in (22), 
the first four terms give Uj, = 1/1-001 in good agreement. 

It is of interest to notice the form of (22) when we take f = nfc in (17) and let n^co, so 
that the distribution is now the negative binomial. We find 
1 4c 3c® 

3(l + c)(a + 2)'''(H-c)®(a + 3)(®)+-"’ 

as given by Pisher (1941) by a different method. Moreover, the likelihood equations (13) 
take the form 


S'^logP^ = S'(a:-ac)/o(l+c) = 0, 

y'Awp = _ ga(^) I 

da ^ ^ la(l + c) 2(a+l)(®)(H-c)®'^3(a + 2)W(l+c) 

where gf(a:) = _ Lc(a + r — 1) ^ - c®(a + r — 1 )<®>— .... 



(23) 


The first two terms of (23) together with S'(a:~ac) = 0 correspond to the moment solution; 
we may use the first three terms to ‘improve’ this solution, neglecting the remainder which 
in any case consists of terms whose expectation is zero. Taking an example given by Haldane 
(1941): 0 1 2 3 466789S 

Frequency 167 267 271 186 111 61 27 8 3 1 1096 

for which the first three factorial moments are 


mij] = 2-156,934, Wtaj = 6-100,365, W[3] = 12-651,460, 
we find from the first three terms of (23) 

l-344,003a3-7-806,648a®-40-625,167a-140-487,797 = 0, 
a solution of which is a = 9-918; Haldane gives a = 9-900 as the maximum hkehhood solution 
and a = 10-44 as the moment solution, so that the use of (23) does in this case lead to an 
improvement. It would appear desirable to know under what conditions series such as (23) 
converge rapidly, and whether it is not just those cases for which the efficiency of moment 
fitting is low which give slow convergence. 


In conclusion I wish to express my thanks to Prof. M. S. Bartlett for helpful criticisms. 
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FIDUCIAL LIMITS OP THE PARAMETER OP A 
DISCONTINUOUS DISTRIBUTION 

By W. L. STEVENS* 

1, The pkoblem 

I'l. It haa long been realized that methods of interval estimation which can be used 
successfully in the case of continuous distributions encounter a special kind of difficulty 
when we attempt to apply them to a discontinuous distribution such as the binomial or the 
Poisson. This difficulty has been expressed in different ways by different writers, their choice 
of words being mainly influenced by whether they are using Fisher’s concept of fiducial 
probability or Neyman’s of confidence intervals. While these approaches are said to be 
fundarnentally different, their applications to the uniparametric case are so closely linked 
that an argument in terms of the one can usually be translated in terms of the other. We shall 
accordingly not hesitate to express our results in the languages of both theories. 

We may begin with the simplest example of a discrete distribution—the binomial. If 
the probability of an event is n, the probability that it will occur / times in n trials is 

= ( ^ 7 ) 1 /!^^ 

The probability that it will happen / or more times is 

= (M2) 

r«/ 

If in a given experiment it did in fact happen/times, we may define 7ro(/), corresponding 
to any probability level, P^, as the root of the equation 

G{S,^o) = P^- 

When / = 0, we define ‘n’o(fi) = 

Then it can readily be shown that if/+ 0, and if 

7r<iT„, 

then Q{J,it)<Pq. 

Thus any hypothesis which puts w < Wq is rejected at the R, level of significance in favour 
of a higher value of tt. Hence ttq is a lower limit to tt and may conveniently be termed the 
lower jF^ hmit of tt. At the chosen level of significance, we accordingly write either 

TT>TT^ or TT ^ Wy. 

Similarly, we may define 7ri(f), the upper limit of n, as the root of the equation 

G*(/+l,7rJ = 1-Pi, (1-14) 

implying that P^ — probability that r is / or fewer. 

When/ = n, we define rT.^{n) = 1. We then write either ttkttxOtti^tTx. Combining the two 
inequalities, we therefore have a statement, either 

7T„ < TT < TT, or TTq ^ W ^ Wi 

* Universidade de Sao Paulo, Paculdade de Ci^ncias Eoonbmioaa, Rua Vila Nova, 268, Sao Paulo, 
Brazil. 
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Fiducial limits 


corresponding to any pair of probability levels, subject to the condition that P(, + Pj< 1. 
(Pq and Pj. are usually but not necessarily equal.) 

Notice that in calculating either limit the probability of the actual result, / observed in n, 
is included. This probability is of course finite, whereas if the observations were drawn from 
a continuous distribution the probability of the actual result would be an infinitesimal. 
It is from this difference that all the trouble springs. 

1*2, Charts and tables. Charts of the limits of tt as functions of n and fjn for Pq = P^ — ^ % 
and 2| % were published by Clopper & Pearson (1934). The present writer noticed that if 
we tabulate nn instead of n and use / and//« instead of n and fjn, we can greatly facilitate 
interpolation, thus covering in a condensed table all the region where the normal approxi¬ 
mation is unsatisfactory. Our table, which covers the range / = 0-15, f/n = 0-1 and Pq or 
Pj^ = 10, 2-5 and 0-6 % appeared in the second edition of Fisher & Yates. 

1-3. The two fiducial distributions. Let us now see what happens when we attempt to define 
the fiducial distribution of tt. Differentiating 0{J, n) with respect to n, we have 



Fig. 1. The pair of fiducial distributions associated with ‘ 3 in 10 ’. 


This is an admissible probability distribution, since its integral between 0 and I is unity. 
(See left curve in Fig. 1 for the case -a = 10 and/ = 3.) Moreover, if we write 



(1-32) 


the value of Vq satisf 3 dng this equation is in fact the lower Pq limit of rr. If only we could also 
obtain the upper P^ limit by solving 




/io(7r)d7r= l-Pj, 


(1-33) 
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then we could, legitimately call the fiducial distribution of tj. But, of course, we can do 
no such thing. We have to define a second distribution of tt, 

, , , , dG{f+ l,7r) , -n,! 

hi{7T)d7r = - 'dTT = (1-34) 

(See right curve in Fig. 1.) The upper limit of tt is then the tt^ which satisfies the equation 

f hj{v)d7T ^\~P^. (l-SS) 


Thus we see that the unique fiducial distribution obtainable from a continuous distribution 
(where a sufficient statistic exists) becomes resolved in the discrete case into a fair of 
distributions. 

It is a matter of taste, up to this point in the argument, whether we choose to say that there 
is no fiducial distribution associated with the re3ult,/in n, or whether we say that each result 
has associated with it a unique pair of fiducial distributions. At any rate, these two between 
them perform the same service as is performed by the unique fiducial distribution in the 
continuous case, namely, that of supplying limits to the parameter, corresponding to any 
pair of significance levels. The only extra rule we need is the simple one, that when finding 
lower limits we use /io(7r) and when upper limits, hj(7r). 

1 A. Fisher’s discussion of the problem. The peculiar nature of the fiducial argument when 
applied to discontinuous data has been expressed differently by Fisher (1936). He was there 
discussing a fourfold table, showing twins of convicts classified as convicted or not-con- 
vioted and monozygotic or dizygotic. The relevant parameter is the cross-product of the 
cellular probabilities 


but it is evident that all his remarks are applicable to the example of the binomial distribu¬ 
tion, The passage must be quoted; 

.. .We may thus infer that the observations dififer significantly at the 1 % level of sig¬ 
nificance, from any hypothesis which makes fr greater than 0-48 .... This is not a pro¬ 
bability statement about fr. It is a foi’mally precise statement of the results of applying 
testa of significance. If, however, the data had been continuous in distribution, on the 
hypothesis considered, it would have been equivalent to the statement that the fiducial 
probability that fr exceeds 0-48 is just one chance in a hundred. With discontinuous data, 
however, the fiducial argument only leads to the result that this probability does not exceed 
O'Ol. We have a statement of inequality, and not one of equality. It is not obvious in 
such cases, that, of the two forms of statement possible, the one explicitly framed in terms 
of probability has any practical advantage. The reason why the fiducial statement loses 
its precision with discontinuous data is that the frequencies in our table make no dis¬ 
tinction between a case in which two dizygotic convicts were only just convicted, perhaps 
on venial charges, or as first offenders, while the remaining 16 had characters above 
suspicion, and an equally possible case in which the two convicts were hardened offenders, 
and some at least of the remaining 16 had barely escaped conviction. If we knew where we 
stood in the range of possibilities represented by these two examples, and had similar 
information with respect to the monozygotic twins, the fiducial statements derivable 
from the data would regain their exactitude. 



120 


Fiducial limits 


The explanation here advanced for the loaa of precision in the fiducial statement may strike 
the reader as somewhat metaphysical. Although one can think of a continuous phenomenon 
underlying the discrete classification into convicted and not-convioted, yet in other 
examples such a notion would at once ring a false note. For example, if the classification is 
made according to whether the individual possesses or not a certain gene at a certain locus, 
there can surely be no underlying phenomenon representing all gradations between posses¬ 
sing and not possessing the gene ? Be that as it may, it is curious that the method which we 
are going to develop can be linlred up in a striking way with Fisher’s concept of underlying 
continuity. 

1-5. Confidence intervals for n. Let us next see how the peculiarity of the discontinuous 
distribution problem reveals itself when we write in terms of confidence intervals. Let us 
suppose that we make it a rule always to calculate the lower Pq limit and then to state that 

7r > TTq or 71 > TTfl. 

In following either rule, we shall sometimes make a true statement and sometimes a false 
one. We can therefore define 

Prob {tt > ttq} or ProblTr^Wp} 

as the limit of 

number of times the statement is correct 
number of apphcations of the rule 
as the number of applications tends to infinity. 

As soon as the confidence interval argument was applied to the binomial distribution, it 
was realised, and in fact pointed out in Clopper & Pearson, that 

Prob{7r>7ro}>l-P(, and Prob {tt > Tr#} > 1 - P,,. (LSI) 

This probability is a function of the parameter n. The graph of the complementary function, 
Prob {tt < TTfl } for the case -n- = 10 and P,, = 10 %, is given in Fig. 2. 



Kg. 2. Probability {7r<7ro} when n = 10. 

The curve shows discontinuities at the n points, 

’fo(l). 71 o( 2), 77o(n), 

and it is only at these points that Prob^TT^Tr^} = P^ and hence Prob{ 7 r> 7 ro} = 
Elsewhere, Prob{7r^7rQ} can differ very gravely from 10 %. Leaving out the extreme cases 
® and/ = 10 where we might have expected trouble, we are stiU left with a variation 
from I to 10 %. 
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Similarly, it can be shown that, having calculated an upper limit, then 
Prob{7r<7ri}> 1—Pi and Prob{7r^7ri}> 1-P^. 

The equality sign holds only at the n points of discontinuity, 

7ri(0), 7ri(2), 

Combining (l-Sl) and (1-52), we conclude that 

Prob{7r(,<7r<7ri}^ 1-P(,-Pi i 
and Prob{7ro<7r<7ri}>l-Po-Pi.J 

We can say further that there ‘always’* exists a positive quantity D greater than zero, 
such that Prob{7ro<7r<:n-i}>l+P-Po^Pi. (1-64) 

Now the use of 1 — P,, —P^ (the confidence coefficient) as a measure of our confidence in the 
assertion, 7Tq<tt< tt^, has been justified by two lines of argument: {a) that in the limit, when 
n is large, the inequality sign may be replaced by the equality sign, and (6) that the calculated 
confidence coefficient is necessarily conservative, i.e. on the ‘safe side’, because the true 
probability of tt being between the limits is ‘always’ greater than is stated. The first type of 
argument need not be taken too seriously, since it amounts to no more than saymgthat any 
small-sample test tends in the Mmit to the corresponding large-sample teat, which, although 
true, would hardly be a reason for ignoring the small sample test if it were available. The 
second type of justification is a much more serious matter and, in the view of the present 
writer, is completely invalid. 

It is the very basis of any theory of estimation, that the statistician shall be permitted 
to be wrong a certain proportion of times. Working within that permitted proportion, it is 
his job to find a pair of limits as narrow as he can possibly make them. If, however, when he 
presents us with his calculated limits, he says that his probability of being wrong is less than 
his permitted probability, we can only reply that his limits are unnecessarily wide and that 
he should narrow them until he is running the stipulated risk. Thus we reach the important, 
if at first sight paradoxical conclusion, that it is a statistician's duty to be turong the stated 
proportion of times, and failure to reach this proportion is equivalent to using an inefficient 
in place of an efficient method of estimation. 

Of course, this criticism begs the fundamental question of whether we can, while still not 
exceeding the stipulated probabilities of being wrong at either limit, find an interval lying 
within the interval found by the usual method. We shall now show that we can do this and 
more. In fact, it is possible to find a pair of limits and such that 

Prob{7r5s7ro} = 1-Po. 

Prob (tt < TTj} = 1 — Pj, 

and hence Prob{7ro<7r<7rJ = 1 — Pq—P j, (PSB) 

and these limits wiU ‘ always ’ be wholly inside the hmits customarily calculated. This means 
that we can recover for the discontinuous problem the exact type of fiducial or confidence 
interval statement which is possible in continuous problems. 

* We shall use inverted commas and write ‘always ’ when we mean that the probabihty of the event 
is unity but that it need not happen. Similarly, we shall say an event ‘never ’ happens when it can happen 
but its probability is zero. Thus if a: is drawn at random from the rectangular distribution 0^a!< 1, we 
say that x is ‘always’ greater than zero, ‘never’ equal to zero, but never equal to unity. 


(1-62) 


(1-63) 
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2 . The solxjtiok 

2-1 Suppose that in n trials the event has occurred / times, Then define a variable y by 
the equation y=f+x, (2-11) 

where x is any number chosen at random from the rectangular distribution, 0 ^ a: < 1. (This 
means, in practice, that x is a decimal point followed by a sequence of digits taken from a 
table of random numbers.) The quantity y is accordingly any real number m the range 
0 ^ 2/ < 1 ■ We may also note that y uniquely determines / and x, since / is the whole and 

y the fractional part of y. 

Since y is the sum of two quantities, each drawn from a known distribution, it follows 
that its own distribution is determinate, and can in fact be found without difficulty. Now 
since y uniquely determines/, it is evidently a sufficient statistic for 77 . We therefore need not 
hesitate to apply the fiducial probability argument. Thus, if 

y =/+® 

and 2/o=/o + ^’'o. 

Prob { 1 / > 1 / 0 } = Prob {/ >/«} + Prob {/=/o) Prob [x ^.%} 

= G*(/o + 1,7r) + 7 t) (1 -Xn) 

= a;o0(/o+l,rr)-(-(l-a:o)G'(/o>7f)- (2-12) 

Differentiating this probability with respect to n, and dropping the suffices on / and x, we 
thus define a distribution function 

h.Jjj)dTr — xhfi,{T!)dit + {\—x)\{n)d7r, (2T3) 

where and are the functions already defined in (h31) and (1-34). 

We propose to call dn the fiducial distribution of n. Notice, however, that it is defined 

only after we have drawn our value of x. Given merely the number /, then there exists an 
infinite continuum of such distributions ranging between the pair of distributions AoItt) d-n 
and hi{TT)d7r which appeared in the earlier discussion. Now it is essential that the fiducial 
distribution of a parameter should be unique. This, however, can be assured by the following 
simple rule: 

When any experiment has been performed (or series of observations taken), the investi¬ 
gator is allowed once and once only to select, at random, his value of x; the distribution thus 
determined will he called the fiducial distribution of n, and neither he nor anyone else is 
permitted another drawing of the number x. 

As a result of this rule, we find that a fiducial distribution is uniquely determined for each 
experiment, though not for each value of/. Now it will readily be seen that the fiducial limits 
found by integrating h^{7T) dn ‘ always ’ lie wholly inside the fiducial limits found by the usual 
method. Moreover, since 1 / is a continuous variable, the statements in fiducial probability 
become statements of equality instead of statements of inequality. 

2-2. Demonstration. To clarify these remarks, let us first examine the functional relation 
between y and n. Corresponding to any probability P (for a lower limit) or 1 — P (for an upper 
limit), we have the following equation relating y and tt: 

x(?(/+l,7r) + (l-x)G(/,7r) = P. (2-21) 

Differentiating totally with respect to x, we get 

0 

dx 9x dn dx~ 
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Hence -gif)i-h{7i)~== Q. (2-22) 

Hence dnidx is everywhere finite and positive. 

However, if y < 1 - P, i.e. if / = 0 and a: < 1 - P, the equation becomes 

(l-7r)» = (l~P)/a;, 

thus yielding a negative value for tt. We must therefore define -n as zero, when y<l-P. 
Similarly, we define n as unity when y>n + l — P. 

Next we note that as a;->-1 the equation tends to 

G(/+l,/r) = P, 

which is the equation appropriate to t/ =/+ 1. Hencezr is a continuous function of j/, although 
the derivative dnjdy is discontinuous at the integral values of y. The graph of n against y is 
in fact a series of ascending loops, like a telegraph wire going up a mountain side. We con¬ 
clude therefore that y uniquely determines tt and that n, if not equal to zero or unity, also 
uniquely determines y. Under this same restriction, we also see that Ti[y) and yijr) are ever- 
increasing functions of each other. Moreover, since the lower limit, as usually calculated, 
can be found from the method here proposed by putting a; = 0, it follows that the new method 
‘always’ yields a higher value for the lower Hmit. Similarly, it can be shown that it yields 
a lower value for the upper limit. 

Now let w (0 < TT < 1) represent the true parametric value, and let y — y{ir) be the corre¬ 
sponding y at a chosen level P^. Suppose we draw at random a sample of n observations and 
encounter the event/g times in the sample. To this/g we add our randomly chosen in order 
to produce y^, which then uniquely determines zr^, the lower Pg hmit. In repeated apphca- 
tions of this procedure, we may accordingly define 

Prob {Wg < 7r}. 

However, Wg < tt imphes i/g < y. Hence 

Prob {wg < 7 t} = Prob {yg < y} = 1 - Prob {t/g ^ 2/} = 1 - Pg. (2-23) 

Hence Prob (wg < n}, in the sense of the Neyman-Pearson theory, is exactly equal to 1 - Pg. 
Since y is continuous it is immaterial whether we write 

Prob (zTg < tt} — 1—Pg or Prob {n-g ^ tt} = 1 - Pg. 

Similarly, if Wi is the upper P^ limit, then 

Prob {n < TTj} = Prob {n < Wj} = 1 — P^. {2'24) 

Combining the two statements, we therefore have 

Prob{zrg<zr<7ri} == Prob(7rg<7r<7rJ = 1 —Pg—P^. (2-26) 

These equations hold for all values of n in the open interval 0 < zr < 1. Is it possible to close 
the interval? Yes, if we adopt the following rules: 

When zTg = 0, we must write O^zr. 

When TTg = 1, we must write 1 < zr. 

When TTx = 0, we must write zr < 0. 

When TTi = 1, we must write zr^^l. 

Under these rules, it can be shown that the equations are true, even for zr = 0 and zr = 1. 
However, the solution is a little artificial, since in two instances we have to make statements 
which we know to be false. Perhaps the proper answer is that in practice we can rule out the 
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possibility of either tt = 0 or tt = 1, for if, in fact, we thought that n was small and possibly 
zero (or large and possibly unity) we would have employed a different experimental tech¬ 
nique, namely that of inverse sampling. 

2-3. Alternative solutions. Once the idea of introducing a random variate has been 
admitted, one may inquire whether it need have been drawn from a rectangular distribution. 
Could it not have been drawn from some other distribution, and if so, could we not find some 
distribution which would result m yet narrower limits? 

Suppose z to be drawn from any continuous distribution, j(z) dz, over any range. Then we 
may consider the jouit distribution of the pair of sampling variables, / and z. Let us say, 
conventionaUy, that ^ ^o) 


means that either 


or 


/>/o 

/ = /o and z>z„. 


From this we have 


Prob{(/,z)>(/o,zo)} = f j{z)dzG(fo+l,Tr)+( j{z)dzQ(fo,7f). (2-31) 

J — 00 J Zt 

Differentiating with respect to n and removing the suffices, we would again have a fiducial 
distribution of tt, which might he offered as an alternative to dir. 

However, a moment’s thought will show that this method yields the same solution in a 
different guise. In order to draw at random from j(z)dz we would have to select at 
random from the rectangular distribution 0 < < 1, and then solve the equation 

^o=f (2-32) 

J —00 

Eeplaoing the integrals in equation (2'31), we obtain 

Prob{(/, z) > (/o, Z(,)} = a;o<?(/o+ 1, w) + (1 - x^) Gif^, n). (2-33) 

This is the same equation as we used before (2-12). Hence we would obtain the same fiducial 
distributions with the same frequency, the only difference being that they would be differ¬ 
ently labelled. 

On the other hand, let us consider what happens when the distribution from which we 
draw z contains points of concentration, e.g. a point z = Z, where Prob {z — Z} = a, a finite 
quantity. If then we write 


ro_j_ 


j{z)dz, 


there wiU be a one-one relation between Xq and Zq everywhere except when Zq = Z, in which 
point there is a series of values of Kq, Z ^ aio < Z -t- a, corresponding to the one value of Zg. 
As a result, we find that in this range of Xg, the lower limit remains constant at the value 
7r(/-f Z), i.e. instead of cohtinuing to rise smoothly, the graph of rr^ against Xg runs hori¬ 
zontally for a space. Within this interval, it is evident that the calculated lower limits will 
‘always’ be below those foimd from the rectangular distribution. It can also be shown that 
the inequality sign would have to be returned to the fiducial probability statement if the 
distribution had points of concentration. 

Since we have now shown that alternative methods will either yield the same result, or 
a result which is in two respects less satisfactory, we conclude that we were justified in calling 
h^in) dn the fiducial distribution of n. 
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2'4. ' JJnd&rlying continuity.’ We have seen that the method here proposed replaces 
integral values of/in the range 0 </< ?i, by the continuous variable y in the range 0 < y < rn-1. 
We notice at once the link with Fisher’s notion (quoted earlier) of the discrete variable 
being merely an incohiplete manifestation of a continuous phenomenon. At the same time, 
we must emphasize that the method does not imply, nor does it rest on any idea of, under¬ 
lying continuity. This is proved by the discussion of the preceding section, which showed 
that the x could be drawn from any continuous distribution. Nevertheless, it is interesting 
that the method, in its simplest form, is expressible in terms of a continuous variable over 
the range of/. 

One should also notice here a similarity with a method proposed by Fisher (1936) for 
recovering exact fiducial statements when estimating bacterial density by the dilution 
method. If the dilution ratio is r, Fisher showed that the fiducial statements may be made 
exact if the first dilution ratio is taken as instead of r, where x is drawn at random between 
0 and 1. There is, however, this essential difference: in Fisher’s example a random element is 
introduced before the experiment is performed, whereas here we propose the introduction 
of a random element after the experiment is completed. 

2-5. Choice of the xfor different limits. A question which may be asked is whether, when 
calculating a number of limits, we should select the x once and use it for aU limits, or whether 
we can select a different x for each limit. For the purpose of defining a fiducial distribution, 
it is obvious that x must be chosen once only. On the other hand, if we wish to determine 
one or more confidence intervals, we may choose, at random, a fresh x for every limit. The 
intervals so determined will still be genuine confidence intervals in the sense used by Neyman. 
Nevertheless, it should not be overlooked that such a procedure can lead to paradoxical 
results. Thus we might find a 90 % confidence interval lying wholly inside an 89 % confidence 
interval, i.e. we would have to attach more confidence to the more precise statement. 
Paradoxical though it may sound, the result would be genuine; one would, however, be 
obliged to make both statements in order to maintain the right proportions of true statements 
in the long run. Still one would not hke to be the statistician who is called upon to explain 
such a conundrum to a factory manager who has merely been inquiring into the percentage 
of defective articles in production! Perhaps it would be wise to adopt the rule that the same 
X is to be used for all limits (in any given experiment), thus bringing the confidence intervals 
into line with the fiducial intervals. 


3. Appmoaiton 

3'1. There is no particular obstacle, except time, to tabulating the proposed solution, 
as applied to the problem/of the binomial distribution, or indeed to any other discontinuous 
distribution. Table 1 gives a sample tabulation for the binomial with index =10. Since the 
fiducial distribution is now unambiguous, the percentile points are more logically labelled 
continuously from 0 to 100 %. The upper 10 % limit is of course tabled under 90 %, 

Thus suppose 3 events were encountered in 10 trials. A table of random numbers begins: 
337... We round this to 34 and enter the table with / = 3 and x — 0-34, finding the upper 
and lower 10% limits 13 -l< 7 r< 49-4 (%). 

For comparison, the usual method gives the wider limits, 

11-6 <7r< 66*2 (%). 



